-- Logs begin at Tue 2022-09-06 20:31:42 UTC, end at Tue 2022-09-06 21:36:54 UTC. -- Sep 06 21:04:56.024961 dv-cinder-749155-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 06 21:04:56.034821 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 06 21:04:56.037330 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 6 21:04:56 2022] *** Sep 06 21:04:56.037330 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 06 21:04:56.037330 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 06 21:04:56.037330 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: nodename: dv-cinder-749155-11-iscsi Sep 06 21:04:56.037330 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: machine: x86_64 Sep 06 21:04:56.037330 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: clock source: unix Sep 06 21:04:56.037330 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: pcre jit disabled Sep 06 21:04:56.037330 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: detected number of CPU cores: 4 Sep 06 21:04:56.037330 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: current working directory: / Sep 06 21:04:56.037330 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: detected binary path: /usr/bin/uwsgi-core Sep 06 21:04:56.038056 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: your processes number limit is 47680 Sep 06 21:04:56.038056 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: your memory page size is 4096 bytes Sep 06 21:04:56.038056 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: detected max file descriptor number: 2048 Sep 06 21:04:56.038056 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: lock engine: pthread robust mutexes Sep 06 21:04:56.038056 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: thunder lock: enabled Sep 06 21:04:56.038056 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 06 21:04:56.038056 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 06 21:04:56.082836 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: Python main interpreter initialized at 0x562de12069c0 Sep 06 21:04:56.082836 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: python threads support enabled Sep 06 21:04:56.082836 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: your server socket listen backlog is limited to 100 connections Sep 06 21:04:56.082836 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: your mercy for graceful operations on workers is 90 seconds Sep 06 21:04:56.083236 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: mapped 403077 bytes (393 KB) for 2 cores Sep 06 21:04:56.083236 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: *** Operational MODE: preforking *** Sep 06 21:04:56.085591 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: *** uWSGI is running in multiple interpreter mode *** Sep 06 21:04:56.085591 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: spawned uWSGI master process (pid: 105710) Sep 06 21:04:56.085591 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: spawned uWSGI worker 1 (pid: 105711, cores: 1) Sep 06 21:04:56.085591 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: spawned uWSGI worker 2 (pid: 105712, cores: 1) Sep 06 21:04:56.085591 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 06 21:04:56.083704 dv-cinder-749155-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 06 21:04:56.736824 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 21:04:56.737456 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 21:04:57.823913 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 21:04:57.823913 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: from cryptography.utils import int_from_bytes Sep 06 21:04:57.824565 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 21:04:57.824565 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: from cryptography.utils import int_from_bytes Sep 06 21:04:57.824565 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 21:04:57.824565 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: from cryptography.utils import int_from_bytes Sep 06 21:04:57.825073 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 21:04:57.825073 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: from cryptography.utils import int_from_bytes Sep 06 21:05:00.306710 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 21:05:00.307409 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 21:05:00.307409 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 21:05:00.307860 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 21:05:00.307942 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 21:05:00.308027 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 21:05:00.308101 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 21:05:00.308185 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 21:05:00.308262 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 21:05:00.308337 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 21:05:00.308422 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.308495 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.308747 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.308861 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.309056 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.309165 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.309407 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.309910 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.310072 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.310199 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.310379 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.310477 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.310698 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.310830 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.311015 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.311101 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.311339 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.311431 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.311598 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.311711 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.311911 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.312005 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.312232 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-749155-11-iscsi {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.312327 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-749155-11-iscsi {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.312553 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.312641 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.312886 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.312989 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.313196 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.313294 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.313510 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.313597 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.313813 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.313914 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.314130 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.314217 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.314433 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.314520 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.314930 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.315039 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.316289 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.316407 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.316407 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.316540 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.316606 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.316696 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.316787 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.316862 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.316862 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.316979 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.317043 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.317111 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.317280 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.317368 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.317530 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.317624 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.317845 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.317930 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.318154 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.318249 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.318555 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-749155-11-iscsi {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.318677 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-749155-11-iscsi {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.318874 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.318959 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.319243 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.319333 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.319562 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.319650 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.319978 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.320087 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.320298 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.320469 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.320607 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.320748 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.320943 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.321083 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.321267 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.321379 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.321583 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.321728 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.321889 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.322029 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.322206 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.322332 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.322522 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.322646 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.322839 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.322970 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.323140 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.323301 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.323430 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.323551 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.323736 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.323869 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.324052 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.324175 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.324355 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.324477 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.324682 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.324808 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.324928 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.325044 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.325218 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.325370 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.325571 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.325704 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.325824 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.325943 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.326147 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.326283 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.326415 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.326537 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.326665 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.326797 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.326926 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.327062 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.327243 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.327369 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.327548 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.327670 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.327853 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.327978 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.328155 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.328297 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.328462 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.328591 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.328788 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.328934 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.329092 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.329217 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.329397 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.329528 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.329701 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.329827 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.330018 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.330149 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.330329 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.330453 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.330649 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.330782 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.330956 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.331091 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.331274 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.331413 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.331667 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.331792 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.331910 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.332036 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.332204 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.332336 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.332543 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.332699 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.332882 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.333008 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.333190 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.333323 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.333505 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.333629 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.333822 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.333943 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.334128 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.334268 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.334430 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.334553 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.334760 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.334886 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.335081 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.335206 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.335417 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.335553 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.335739 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.335867 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.336002 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.336108 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.336240 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.336364 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.336540 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.336696 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.336882 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.337006 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.337187 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.337311 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.337492 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.337617 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.337794 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.337927 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.338092 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.338215 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.338395 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.338525 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.338694 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.338816 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.338998 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.339131 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.339302 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.339432 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.339603 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.339718 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.339906 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.340028 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.340206 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.340339 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.340507 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.340628 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.340835 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.340974 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.341133 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.341268 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.341447 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.341572 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.341762 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.341884 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.342067 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.342208 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.342374 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.342526 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.342664 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.342972 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.343106 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.343292 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.343600 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.343731 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.343907 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.344181 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.344309 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.344508 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.344754 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.344882 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.345106 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.345243 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.345433 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.345567 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.345786 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.345918 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.346066 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.346199 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.346341 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.346472 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.346645 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.346769 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.346951 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.347072 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.347253 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.347385 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.347558 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.347691 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.347862 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.348168 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.348303 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.348472 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.348733 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.348860 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.349055 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.349178 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.349372 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.349498 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.349674 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.349791 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.349981 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.350117 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.350290 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.350446 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.350652 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.350774 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.350960 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.351093 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.351269 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.351451 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.351576 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.351703 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.351921 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.352062 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.352230 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.352354 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.352582 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.352940 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.353072 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.353277 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.353520 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.353651 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.353913 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.354081 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.354223 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.354528 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.354651 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:05:00.354855 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.355174 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.355305 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.355488 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.355801 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.356002 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.356125 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.356242 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.356428 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.356561 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.356789 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.356914 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.357110 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.357236 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.357427 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.357560 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.357748 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.357873 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.358061 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.358197 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.358379 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.358524 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.358690 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.358814 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.359003 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.359140 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.359314 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.359450 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.359632 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.359790 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.359991 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.360174 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.360314 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.360615 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.360849 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.360976 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.361266 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.361422 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.361566 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.361877 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.362013 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.362201 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.362484 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.362617 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.362816 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.362941 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.363136 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.363420 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.363546 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.363757 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.363877 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.364072 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.364194 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.364383 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.364497 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.364716 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.364846 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.365036 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.365148 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.365349 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.365469 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.365687 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.365808 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.366048 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.366201 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.366360 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.366483 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.366774 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.366961 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.367083 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.367201 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.367373 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.367497 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.367687 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.367813 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.367999 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.368122 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.368319 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.368442 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.368628 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.368779 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.368956 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.369080 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.369263 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.369472 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.369594 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.369721 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.369869 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.369988 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.370181 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.370315 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.370491 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.370613 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.370802 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.370925 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.371125 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.371256 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.371431 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.371553 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.371746 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.371871 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.372057 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.372213 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.372372 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.372502 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.372701 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.372834 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.373020 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.373281 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.373410 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.373671 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.373799 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.373986 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.374129 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.374292 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.374417 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.374602 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.374726 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.374909 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.375043 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.375231 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.375364 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.375539 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.375661 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.375852 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.375986 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.376188 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.376320 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.376479 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.376610 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.376813 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.376939 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.377126 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.377258 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.377436 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.377567 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.377744 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.377869 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.378055 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.378180 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.378364 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.378486 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.378668 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.378794 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.378990 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.379116 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.379300 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.379424 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.379605 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.379731 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.379926 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.380155 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.380372 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.380512 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.380635 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.380794 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.380917 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.381091 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.381217 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.381402 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.381527 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.381765 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.381892 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.382105 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.382229 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.382418 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.382539 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.382730 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.382940 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.383072 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.383192 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.383387 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.384027 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.384165 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.384165 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.384402 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.384541 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.385150 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.385150 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.385390 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.385511 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.385631 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.385763 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.385886 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.386005 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.386136 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.386272 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.386458 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.386594 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.386718 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.386845 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.387000 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.387192 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.387317 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.387509 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.387643 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.387859 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.387992 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.388166 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.388298 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.388486 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.388612 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.388817 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.388941 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.389119 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.389259 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.389422 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.389546 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.389722 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.389847 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.390061 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.390200 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.390367 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.390492 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.390998 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.391128 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.391246 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.391383 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.391903 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.392025 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.392151 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.392275 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.392404 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.392525 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.392826 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.392954 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.393088 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.393217 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.393395 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.393522 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.393717 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.393850 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.394048 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.394172 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.394363 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.394487 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.394675 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.394799 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.394998 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.395122 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.395309 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.395442 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.395629 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.395753 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.395933 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.396066 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.396246 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.396382 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.396587 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.396757 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.396920 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.397058 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.397258 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.397383 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.397873 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.397873 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.398118 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.398247 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.398419 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.398937 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.398937 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.399176 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.399336 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.399456 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.399620 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.399746 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.399951 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.400074 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.400270 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.400473 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.400595 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.400749 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.400938 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.401076 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.401266 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.401402 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.401593 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.401716 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.401870 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.401995 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.402185 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.402319 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.402511 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.402635 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.402832 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.402962 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.403139 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.403265 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.403450 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.403574 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.403768 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.403890 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.404075 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.404199 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.404384 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.404525 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.404710 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.404837 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.405015 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.405142 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.405321 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.405447 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.405630 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.405769 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.405946 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.406076 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.406253 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.406375 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.406634 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.406783 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.406906 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.407024 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.407142 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.407261 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.407456 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.407591 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.407759 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.407883 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.408061 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.408185 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.408369 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.408508 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.408706 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.408846 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.409019 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.409153 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.409337 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.409466 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.409643 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.409766 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.409946 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.410068 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.410249 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.410375 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.410567 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.410703 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.410874 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.410995 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.411171 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.411295 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.411473 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.411597 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.411774 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.411906 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.412116 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.412249 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.412425 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.412558 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.412764 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.412955 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.413139 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.413273 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.413454 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.413578 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.413761 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.413898 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.414076 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.414200 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.414387 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.414509 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.414691 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.414828 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.415010 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.415134 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.415323 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.415446 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.415629 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.415764 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.415937 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.416062 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.416244 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.416368 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.416553 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.416792 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.416921 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.417041 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.417191 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.417334 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.417500 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.417627 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.417817 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.417947 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.418114 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.418238 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.418416 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.418540 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.418724 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.418848 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.419041 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.419313 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.419615 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.419742 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.419948 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.420081 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.420260 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.420395 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.420580 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.420755 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.420944 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.421080 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.421260 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.421401 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.421587 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.421713 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.421898 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.422033 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.422210 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.422336 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.422512 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.422635 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.422819 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.422936 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.423123 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.423239 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.423427 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.423565 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.423731 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.423854 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.424032 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.424162 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.424334 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.424547 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.424697 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.424821 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.424941 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.425061 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.425246 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.425383 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.425549 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.425681 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.425850 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.425980 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.426154 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.426288 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.426458 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.426581 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.426761 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.426958 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.427092 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.427214 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.427360 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.427486 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.427677 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.427799 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.427983 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.428107 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.428286 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.428419 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.428612 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.428768 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.428941 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.429069 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.429278 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.429411 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.429580 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.429710 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.429979 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.430122 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.430308 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.430433 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.430613 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.430751 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.430920 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.431046 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.431231 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.431354 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.431539 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.431672 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.431843 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.431975 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.432145 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.432270 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.432446 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.432584 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.432779 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.432904 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.433086 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.433211 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.433387 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.433525 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.433695 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.433825 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.433999 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.434121 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.434307 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.434431 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.434968 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.435093 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.435272 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.435397 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.435575 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.435699 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.435875 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.435997 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.436186 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.436310 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.436490 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.436616 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.436815 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.436966 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.437153 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.437279 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.437413 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.437543 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.437711 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.437835 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.438010 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.438147 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.438311 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.438443 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.438609 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.438732 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.438924 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.439059 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.439226 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.439363 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.439528 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.439660 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.439827 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.439961 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.440136 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.440259 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.440440 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.440565 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.440762 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.440901 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.441083 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.441216 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.441389 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.441513 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.441691 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.441815 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.441995 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.442133 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.442297 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.442428 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.442596 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.442714 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.442897 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.443029 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.443207 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.443332 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.443525 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.443650 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.443830 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.443955 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.444154 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.444288 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.444491 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.444616 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.444825 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.444951 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.445136 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.445278 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.445438 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.445561 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.445740 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.445875 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.446042 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.446181 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.446344 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.446467 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.446650 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.446775 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.446951 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.447085 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.447283 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.447407 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.447558 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.447692 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.447865 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.448001 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.448165 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.448290 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.448473 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.448604 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.448822 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.448948 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.449206 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.449342 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.449449 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.449552 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.449810 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.449942 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.450116 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.450241 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.450432 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.450556 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.450754 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.450880 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.451065 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.451198 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.451376 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.451501 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.451680 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.451803 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.451982 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.452105 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.452296 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.452431 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.452605 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.452773 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.452936 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.453071 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.453239 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.453438 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.453561 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.453690 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.453848 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.453972 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.454157 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.454290 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.454464 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.454595 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.454780 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.454906 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.455104 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.455235 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.455409 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.455533 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.455713 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.455836 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.456022 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.456155 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.456330 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.456452 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.456640 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.456798 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.456967 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.457086 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.457331 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.457463 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.457583 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.457701 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.457874 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.457999 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.458181 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.458305 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.458492 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.458624 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.458799 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.458923 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.459101 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.459231 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.459410 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.459538 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.459730 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.459929 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.460090 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.460215 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.460402 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.460537 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.460732 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.460858 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.461035 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.461160 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.461343 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.461475 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.461644 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.461775 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.461950 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.462075 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.462250 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.462382 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.462683 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.462808 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.462993 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.463115 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.463300 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.463430 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.463604 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.463727 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.463912 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.464034 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.464222 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.464347 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.464540 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.464685 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.464873 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.465010 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.465173 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.465306 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.465586 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.465719 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.465897 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.466019 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.466207 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.466345 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.466514 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.466640 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.466820 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.466944 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.467119 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.467238 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.467434 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.467576 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.467739 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.467854 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.468042 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.468141 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.468347 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.468453 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.468649 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.468780 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.468985 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.469074 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.469286 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.469374 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.469607 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.469705 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.470010 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.470104 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.470318 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.470407 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.470620 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.470721 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.471034 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.471120 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.471342 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.471437 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.471652 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.471751 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.471971 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.472068 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.472291 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.472386 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.472595 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.472714 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.472931 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.473034 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.473246 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.473343 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.473553 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.473659 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.473871 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.473961 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.474182 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.474267 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.474490 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.474577 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.474798 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.474886 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.475098 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.475193 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.475446 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.475533 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.475763 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.475850 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.476073 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.476159 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.476394 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.476492 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.476829 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.477032 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.477159 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.477314 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.477453 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.477682 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.477823 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.477962 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.478093 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.478221 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.478370 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.478505 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.478671 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.478806 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.478979 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.479109 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.479280 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.479404 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.479583 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.479708 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.479897 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.480021 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.480199 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.480324 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.480511 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.480636 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.480847 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.480986 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.481155 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.481279 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.481457 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.481591 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.481759 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.481892 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.482071 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.482195 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.482371 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.482494 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.482690 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.482822 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.483005 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.483129 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.483323 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.483447 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.483628 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.483759 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.483933 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.484065 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.484253 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.484375 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.484560 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.484713 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.484885 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.485018 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.485188 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.485323 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.485490 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.485625 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.485823 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.485953 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.486121 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.486245 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.486440 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.486578 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.486771 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.486908 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.487082 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.487205 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.487396 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.487520 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.487727 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.487861 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.488044 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.488176 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.488359 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.488483 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.488679 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.488806 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.489001 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.489125 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.489307 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.489431 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.489610 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.489733 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.489911 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.490051 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.490215 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.490340 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.490516 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.490647 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.490816 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.490950 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.491176 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.491300 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.491484 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.491609 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.491789 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.491922 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.492090 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.492213 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.492390 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.492516 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.492765 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.492972 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.493097 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.493253 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.493398 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.493521 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.493707 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.493850 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.493980 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.494102 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.494231 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.494353 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.494488 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.494610 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.494820 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.494955 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.495122 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.495261 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.495450 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.495581 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.495759 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.495883 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.496082 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.496207 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.496400 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.496524 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.496739 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.496866 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.497057 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.497196 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.497369 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.497495 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.497684 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.497895 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.498020 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.498149 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.498298 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.498422 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.498606 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.498733 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.498921 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.499054 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.499234 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.499358 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.499549 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.499761 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.500074 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.500202 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.500398 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.500522 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.500736 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.500863 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.501052 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.501179 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.501366 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.501488 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.501689 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.501817 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.501989 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.502115 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.502300 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.502425 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.502610 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.502743 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.502920 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.503044 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.503229 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.503354 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.503557 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.503690 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.503878 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.504002 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.504201 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.504333 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.504525 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.504684 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.504866 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.504993 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.505181 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.505305 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.505495 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.505631 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.505811 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.505937 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.506155 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.506287 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.506466 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.506613 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.506802 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.506925 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.507120 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.507263 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.507436 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.507560 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.507752 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.507884 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.508059 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.508193 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.508371 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.508495 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.508877 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.509012 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.509139 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.509271 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.509394 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.509514 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.509634 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.509754 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.509927 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.510062 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.510255 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.510382 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.510579 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.510704 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.510901 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.511025 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.511221 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.511345 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.511537 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.511660 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.511851 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.511984 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.512166 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.512369 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.512710 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.512837 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.513020 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.513145 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.513352 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.513479 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.513674 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.513805 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.513994 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.514125 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.514308 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.514434 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.514625 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.514759 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.514932 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.515063 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.515240 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.515362 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.515545 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.515684 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.515853 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.515976 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.516159 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.516283 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.516462 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.516599 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.516804 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.516928 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.517111 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.517237 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.517411 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.517536 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.517732 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.517856 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.518119 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.518274 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.518576 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.518705 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.518930 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.519067 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.519249 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.519383 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.519576 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.519709 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.519895 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.520018 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.520204 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.520328 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.520509 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.520633 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.520850 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.520975 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.521155 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.521292 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.521459 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.521594 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.521770 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.521893 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.522078 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.522319 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.522446 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.522566 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.522736 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.522862 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.523047 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.523185 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.523354 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.523489 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.523656 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.523779 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.523960 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.524092 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.524264 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.524465 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.524618 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.524769 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.524891 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.525013 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.525194 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.525318 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.525495 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.525619 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.525800 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.525924 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.526102 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.526224 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.526406 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.526530 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.526709 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.526833 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.527009 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.527141 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.527314 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.527447 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.527614 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.527737 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.527922 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.528047 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.528230 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.528365 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.528545 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.528647 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.528915 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.529041 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.529224 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.529329 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.529528 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.529617 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.529846 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.529934 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.530152 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.530249 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.530458 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.530553 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.530777 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.530864 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.531089 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.531196 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.531406 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.531491 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.531718 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.531804 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.532031 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.532128 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.532375 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.532462 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.532711 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.532957 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.533260 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.533351 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.533597 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.533692 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.533925 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.534078 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.534258 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.534390 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.534569 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.534695 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.534881 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.535016 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.535186 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.535312 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.535493 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.535618 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.535818 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.535952 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.536130 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.536254 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.536441 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.536567 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.536780 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.536923 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.537095 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.537219 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.537407 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.537531 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.537719 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.537880 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.538061 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.538188 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.538393 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.538535 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.538670 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.538790 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.538973 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.539100 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.539282 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.539407 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.539593 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.539718 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.539900 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.540031 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.540210 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.540336 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.540525 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.540672 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.540887 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.541012 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.541207 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.541344 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.541522 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.541645 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.541840 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.541975 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.542154 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.542287 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.542464 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.542588 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.542774 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.542897 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.543083 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.543215 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.543392 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.543518 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.543711 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.543836 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.544024 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.544157 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.544335 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.544466 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.544642 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.545065 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.545355 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.545489 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.545673 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.545806 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.545995 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.546121 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.546311 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.546437 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.546629 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.546752 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.546952 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.547086 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.547265 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.547399 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.547575 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.547699 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.547898 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.548038 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.548210 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.548329 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.548545 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.548682 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.548907 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.549022 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.549231 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.549328 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.549537 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.549625 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.549844 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.549947 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.550146 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.550232 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.550450 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.550552 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.550761 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.550856 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.551072 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.551159 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.551381 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.551467 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.551685 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.551774 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.551986 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.552072 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.552289 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.552377 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.552593 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.552722 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.552929 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.553015 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.553238 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.553326 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.553673 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.553773 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.553989 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.554077 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.554297 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.554420 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.554601 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.554710 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.554906 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.555016 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.555249 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.555346 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.555554 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.555649 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.555859 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.555950 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.556163 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.556259 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.556465 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.556559 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.556847 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.556944 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.557097 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.557194 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.557401 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.557488 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.557702 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.557789 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.558031 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.558129 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.558368 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.558543 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.558770 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.558918 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.559074 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.559214 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.559352 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.559489 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.560027 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.560181 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.560329 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.560484 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.560624 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.560812 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.560951 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.561101 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.561247 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.561387 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.561525 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.561664 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.561801 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.561948 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.562099 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.562239 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.562388 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.562532 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.562694 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.562931 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.563076 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.563213 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.563351 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.563488 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.563625 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.563776 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.563915 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.564052 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.564218 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.564426 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.564685 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.564833 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.564972 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.565122 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.565271 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.565413 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.565560 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.565734 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.565879 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.566017 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.566173 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.566314 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.566460 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.566605 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.566744 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.566882 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.567027 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.567173 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.567312 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.567464 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.567602 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.567739 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.567878 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.568034 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.568173 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.568309 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.568446 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.568584 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.568759 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.568988 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.569164 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.569307 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.569445 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.569582 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.569728 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.569877 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.570016 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.570153 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.570292 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.570429 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.570606 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.570751 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.570931 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.571075 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.571274 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.571420 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.571574 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.571714 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.571954 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.572104 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.572282 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.572438 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.572574 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.572719 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.572930 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.573064 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.573188 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 21:05:00.573298 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:05:00.573459 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 21:05:00.729519 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO dbcounter [None req-6855f311-d80f-48ce-80b5-518cac716c96 None None] Registered counter for database nova_api Sep 06 21:05:00.730156 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO dbcounter [None req-2a12bb22-0a8e-4f70-8707-fa46d8fdea08 None None] Registered counter for database nova_api Sep 06 21:05:00.752436 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG oslo_db.sqlalchemy.engines [None req-6855f311-d80f-48ce-80b5-518cac716c96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105712) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 21:05:00.755584 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_db.sqlalchemy.engines [None req-2a12bb22-0a8e-4f70-8707-fa46d8fdea08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105711) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 21:05:00.759539 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG dbcounter [-] [105712] Writer thread running {{(pid=105712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 21:05:00.763148 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG dbcounter [-] [105711] Writer thread running {{(pid=105711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 21:05:00.817439 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.context [None req-6855f311-d80f-48ce-80b5-518cac716c96 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3890bd42-8750-4042-bca7-2b0af0e72591(cell1) {{(pid=105712) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 21:05:00.820411 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.context [None req-2a12bb22-0a8e-4f70-8707-fa46d8fdea08 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3890bd42-8750-4042-bca7-2b0af0e72591(cell1) {{(pid=105711) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 21:05:00.821393 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG oslo_concurrency.lockutils [None req-6855f311-d80f-48ce-80b5-518cac716c96 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:05:00.821864 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG oslo_concurrency.lockutils [None req-6855f311-d80f-48ce-80b5-518cac716c96 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:05:00.823417 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG oslo_concurrency.lockutils [None req-6855f311-d80f-48ce-80b5-518cac716c96 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:05:00.824180 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG oslo_concurrency.lockutils [None req-6855f311-d80f-48ce-80b5-518cac716c96 None None] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:05:00.824344 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_concurrency.lockutils [None req-2a12bb22-0a8e-4f70-8707-fa46d8fdea08 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:05:00.824625 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG oslo_concurrency.lockutils [None req-6855f311-d80f-48ce-80b5-518cac716c96 None None] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:05:00.824879 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_concurrency.lockutils [None req-2a12bb22-0a8e-4f70-8707-fa46d8fdea08 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:05:00.826466 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_concurrency.lockutils [None req-2a12bb22-0a8e-4f70-8707-fa46d8fdea08 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:05:00.826632 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG oslo_concurrency.lockutils [None req-6855f311-d80f-48ce-80b5-518cac716c96 None None] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:05:00.827192 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_concurrency.lockutils [None req-2a12bb22-0a8e-4f70-8707-fa46d8fdea08 None None] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:05:00.827636 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_concurrency.lockutils [None req-2a12bb22-0a8e-4f70-8707-fa46d8fdea08 None None] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:05:00.828695 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO dbcounter [None req-6855f311-d80f-48ce-80b5-518cac716c96 None None] Registered counter for database nova_cell0 Sep 06 21:05:00.829714 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_concurrency.lockutils [None req-2a12bb22-0a8e-4f70-8707-fa46d8fdea08 None None] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:05:00.831762 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO dbcounter [None req-2a12bb22-0a8e-4f70-8707-fa46d8fdea08 None None] Registered counter for database nova_cell0 Sep 06 21:05:00.832792 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO dbcounter [None req-6855f311-d80f-48ce-80b5-518cac716c96 None None] Registered counter for database nova_cell1 Sep 06 21:05:00.835782 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO dbcounter [None req-2a12bb22-0a8e-4f70-8707-fa46d8fdea08 None None] Registered counter for database nova_cell1 Sep 06 21:05:00.841911 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG oslo_db.sqlalchemy.engines [None req-6855f311-d80f-48ce-80b5-518cac716c96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105712) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 21:05:00.843338 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG oslo_db.sqlalchemy.engines [None req-6855f311-d80f-48ce-80b5-518cac716c96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105712) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 21:05:00.844310 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_db.sqlalchemy.engines [None req-2a12bb22-0a8e-4f70-8707-fa46d8fdea08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105711) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 21:05:00.847510 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_db.sqlalchemy.engines [None req-2a12bb22-0a8e-4f70-8707-fa46d8fdea08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105711) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 21:05:00.848240 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG dbcounter [-] [105712] Writer thread running {{(pid=105712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 21:05:00.851021 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG dbcounter [-] [105711] Writer thread running {{(pid=105711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 21:05:00.987016 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG dbcounter [-] [105712] Writer thread running {{(pid=105712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 21:05:00.991741 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG dbcounter [-] [105711] Writer thread running {{(pid=105711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 21:05:00.996316 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO dbcounter [None req-6855f311-d80f-48ce-80b5-518cac716c96 None None] Registered counter for database nova_cell0 Sep 06 21:05:01.000935 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO dbcounter [None req-2a12bb22-0a8e-4f70-8707-fa46d8fdea08 None None] Registered counter for database nova_cell0 Sep 06 21:05:01.005746 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG oslo_db.sqlalchemy.engines [None req-6855f311-d80f-48ce-80b5-518cac716c96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105712) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 21:05:01.008446 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_db.sqlalchemy.engines [None req-2a12bb22-0a8e-4f70-8707-fa46d8fdea08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105711) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 21:05:01.011272 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG dbcounter [-] [105712] Writer thread running {{(pid=105712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 21:05:01.013787 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG dbcounter [-] [105711] Writer thread running {{(pid=105711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 21:05:01.347881 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: WARNING keystonemiddleware.auth_token [None req-6855f311-d80f-48ce-80b5-518cac716c96 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 21:05:01.349524 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: WARNING keystonemiddleware.auth_token [None req-2a12bb22-0a8e-4f70-8707-fa46d8fdea08 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 21:05:01.355313 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: WARNING keystonemiddleware.auth_token [None req-6855f311-d80f-48ce-80b5-518cac716c96 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 21:05:01.356863 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: WARNING keystonemiddleware.auth_token [None req-2a12bb22-0a8e-4f70-8707-fa46d8fdea08 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 21:05:01.697795 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: WARNING keystonemiddleware.auth_token [None req-6855f311-d80f-48ce-80b5-518cac716c96 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 21:05:01.698321 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: WARNING keystonemiddleware.auth_token [None req-2a12bb22-0a8e-4f70-8707-fa46d8fdea08 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 21:05:01.703699 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: WARNING keystonemiddleware.auth_token [None req-6855f311-d80f-48ce-80b5-518cac716c96 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 21:05:01.704282 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: WARNING keystonemiddleware.auth_token [None req-2a12bb22-0a8e-4f70-8707-fa46d8fdea08 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 21:05:01.709003 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562de12069c0 pid: 105712 (default app) Sep 06 21:05:01.709612 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562de12069c0 pid: 105711 (default app) Sep 06 21:05:01.711201 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-6855f311-d80f-48ce-80b5-518cac716c96 None None] Calling method '>' {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:05:01.712394 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-6855f311-d80f-48ce-80b5-518cac716c96 None None] 10.222.0.79 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001836 Sep 06 21:05:01.712806 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 1/1] 10.222.0.79 () {50 vars in 788 bytes} [Tue Sep 6 21:05:01 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:06:24.763596 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-2a12bb22-0a8e-4f70-8707-fa46d8fdea08 None None] Calling method '>' {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:06:24.764939 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-2a12bb22-0a8e-4f70-8707-fa46d8fdea08 None None] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002650 Sep 06 21:06:24.765355 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 1/2] 10.222.0.79 () {54 vars in 931 bytes} [Tue Sep 6 21:06:24 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:06:24.777767 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG dbcounter [-] [105712] Writing DB stats nova_api:SELECT=3 {{(pid=105712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:24.784951 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG dbcounter [-] [105712] Writing DB stats nova_cell1:SELECT=3 {{(pid=105712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:24.787167 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG dbcounter [-] [105712] Writing DB stats nova_cell0:SELECT=3 {{(pid=105712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:24.788416 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG dbcounter [-] [105712] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:25.683834 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-d0461d95-82fa-4467-a02e-7dd53a305f27 admin admin] Calling method '>' {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:06:25.717399 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-d0461d95-82fa-4467-a02e-7dd53a305f27 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.945048 Sep 06 21:06:25.718219 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 2/3] 10.222.0.79 () {60 vars in 1292 bytes} [Tue Sep 6 21:06:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:06:28.368399 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-2a12bb22-0a8e-4f70-8707-fa46d8fdea08 None None] Calling method '>' {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:06:28.369450 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-2a12bb22-0a8e-4f70-8707-fa46d8fdea08 None None] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Sep 06 21:06:28.370177 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 2/4] 10.222.0.79 () {54 vars in 931 bytes} [Tue Sep 6 21:06:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:06:28.873949 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-0eab8751-4e6d-4ec9-ae62-6f96592abfea admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "id": "c1", "name": "cirros256"}} {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:06:28.922770 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-0eab8751-4e6d-4ec9-ae62-6f96592abfea admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.545251 Sep 06 21:06:28.923278 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 3/5] 10.222.0.79 () {64 vars in 1283 bytes} [Tue Sep 6 21:06:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 21:06:28.937883 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG dbcounter [-] [105711] Writing DB stats nova_api:SELECT=3 {{(pid=105711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:28.938735 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG dbcounter [-] [105711] Writing DB stats nova_cell0:SELECT=3 {{(pid=105711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:28.940979 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG dbcounter [-] [105711] Writing DB stats nova_cell1:SELECT=3 {{(pid=105711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:28.941548 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG dbcounter [-] [105711] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:29.145956 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-daefa80b-268c-43c0-942c-a7b4876c0d64 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:06:29.213179 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-daefa80b-268c-43c0-942c-a7b4876c0d64 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.280979 Sep 06 21:06:29.213767 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 3/6] 10.222.0.79 () {64 vars in 1336 bytes} [Tue Sep 6 21:06:28 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:06:31.828742 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-0eab8751-4e6d-4ec9-ae62-6f96592abfea admin admin] Calling method '>' {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:06:31.830681 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-0eab8751-4e6d-4ec9-ae62-6f96592abfea admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002396 Sep 06 21:06:31.831224 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 4/7] 10.222.0.79 () {54 vars in 931 bytes} [Tue Sep 6 21:06:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:06:32.481011 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-db393524-53b2-428d-8ca0-34d6ac4522c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 5, "swap": 0, "os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "rxtx_factor": 1.0}} {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:06:32.521852 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-db393524-53b2-428d-8ca0-34d6ac4522c1 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.682912 Sep 06 21:06:32.522593 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 4/8] 10.222.0.79 () {64 vars in 1283 bytes} [Tue Sep 6 21:06:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 21:06:32.535202 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-cc0c9f3a-1589-4ede-9424-349104414345 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:06:32.578047 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-cc0c9f3a-1589-4ede-9424-349104414345 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046831 Sep 06 21:06:32.578955 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 5/9] 10.222.0.79 () {64 vars in 1336 bytes} [Tue Sep 6 21:06:32 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:06:35.202087 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-db393524-53b2-428d-8ca0-34d6ac4522c1 admin admin] Calling method '>' {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:06:35.203117 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-db393524-53b2-428d-8ca0-34d6ac4522c1 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Sep 06 21:06:35.203520 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 5/10] 10.222.0.79 () {54 vars in 931 bytes} [Tue Sep 6 21:06:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:06:35.645652 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-c2917eaf-cc31-4a09-909d-fbfbcbd1f0f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 1024, "name": "ds1G", "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:06:35.669422 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-c2917eaf-cc31-4a09-909d-fbfbcbd1f0f8 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.458449 Sep 06 21:06:35.669950 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 6/11] 10.222.0.79 () {64 vars in 1283 bytes} [Tue Sep 6 21:06:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 21:06:35.682164 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-44bb007a-9074-4eb9-8cd5-1bcb82f6f79c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:06:35.707937 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-44bb007a-9074-4eb9-8cd5-1bcb82f6f79c admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029502 Sep 06 21:06:35.708519 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 6/12] 10.222.0.79 () {64 vars in 1336 bytes} [Tue Sep 6 21:06:35 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:06:38.329560 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-c2917eaf-cc31-4a09-909d-fbfbcbd1f0f8 admin admin] Calling method '>' {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:06:38.331216 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-c2917eaf-cc31-4a09-909d-fbfbcbd1f0f8 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002067 Sep 06 21:06:38.331579 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 7/13] 10.222.0.79 () {54 vars in 931 bytes} [Tue Sep 6 21:06:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:06:38.723776 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-a49a5b08-6a5c-4ce0-adcd-7e78582f30f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "d3", "disk": 10, "os-flavor-access:is_public": true, "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds2G"}} {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:06:38.745852 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-a49a5b08-6a5c-4ce0-adcd-7e78582f30f3 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.407831 Sep 06 21:06:38.746576 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 7/14] 10.222.0.79 () {64 vars in 1283 bytes} [Tue Sep 6 21:06:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 21:06:38.758553 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-993a89ca-b816-4f52-9931-f1421088b789 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:06:38.783635 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-993a89ca-b816-4f52-9931-f1421088b789 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028721 Sep 06 21:06:38.784440 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 8/15] 10.222.0.79 () {64 vars in 1336 bytes} [Tue Sep 6 21:06:38 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:06:41.435367 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-a49a5b08-6a5c-4ce0-adcd-7e78582f30f3 admin admin] Calling method '>' {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:06:41.436472 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-a49a5b08-6a5c-4ce0-adcd-7e78582f30f3 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001900 Sep 06 21:06:41.437117 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 8/16] 10.222.0.79 () {54 vars in 931 bytes} [Tue Sep 6 21:06:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:06:41.909906 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-202c1415-99a7-4114-91f3-2854a5101cb5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 4096, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds4G", "rxtx_factor": 1.0, "vcpus": 4, "disk": 20}} {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:06:41.933053 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-202c1415-99a7-4114-91f3-2854a5101cb5 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.485731 Sep 06 21:06:41.933677 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 9/17] 10.222.0.79 () {64 vars in 1283 bytes} [Tue Sep 6 21:06:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 21:06:41.946989 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-69d0bacc-e7b6-4818-8ef8-488e954baeca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:06:41.974938 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-69d0bacc-e7b6-4818-8ef8-488e954baeca admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031556 Sep 06 21:06:41.976183 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 9/18] 10.222.0.79 () {64 vars in 1336 bytes} [Tue Sep 6 21:06:41 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:06:44.639067 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-202c1415-99a7-4114-91f3-2854a5101cb5 admin admin] Calling method '>' {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:06:44.640136 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-202c1415-99a7-4114-91f3-2854a5101cb5 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001599 Sep 06 21:06:44.640548 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 10/19] 10.222.0.79 () {54 vars in 931 bytes} [Tue Sep 6 21:06:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:06:45.152192 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-9751b993-eaac-4755-9810-3327eab3ce04 admin admin] Calling method '>' {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:06:45.187294 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-9751b993-eaac-4755-9810-3327eab3ce04 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.539358 Sep 06 21:06:45.188146 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 10/20] 10.222.0.79 () {60 vars in 1292 bytes} [Tue Sep 6 21:06:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:06:48.038374 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-202c1415-99a7-4114-91f3-2854a5101cb5 admin admin] Calling method '>' {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:06:48.039396 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-202c1415-99a7-4114-91f3-2854a5101cb5 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Sep 06 21:06:48.039787 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 11/21] 10.222.0.79 () {54 vars in 931 bytes} [Tue Sep 6 21:06:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:06:48.449757 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-1861dd10-7f42-4cc7-b811-96ca14d96b90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "id": "1", "ram": 512, "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:06:48.471648 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-1861dd10-7f42-4cc7-b811-96ca14d96b90 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.425392 Sep 06 21:06:48.472182 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 11/22] 10.222.0.79 () {64 vars in 1283 bytes} [Tue Sep 6 21:06:48 2022] POST /compute/v2.1/flavors => generated 402 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 21:06:48.484391 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-069203d6-f0c0-4dd8-8704-bd0aaf074b96 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:06:48.509547 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-069203d6-f0c0-4dd8-8704-bd0aaf074b96 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028795 Sep 06 21:06:48.510140 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 12/23] 10.222.0.79 () {64 vars in 1333 bytes} [Tue Sep 6 21:06:48 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:06:51.124791 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-1861dd10-7f42-4cc7-b811-96ca14d96b90 admin admin] Calling method '>' {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:06:51.125809 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-1861dd10-7f42-4cc7-b811-96ca14d96b90 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 06 21:06:51.126207 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 12/24] 10.222.0.79 () {54 vars in 931 bytes} [Tue Sep 6 21:06:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:06:51.499272 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-6c2a839c-c1b9-4a91-9f51-4679853c8982 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "vcpus": 1, "name": "m1.small", "rxtx_factor": 1.0}} {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:06:51.519976 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-6c2a839c-c1b9-4a91-9f51-4679853c8982 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.387512 Sep 06 21:06:51.524689 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 13/25] 10.222.0.79 () {64 vars in 1283 bytes} [Tue Sep 6 21:06:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 21:06:51.532889 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-1f239ce7-1e8f-49b0-b19d-e9229699f7e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:06:51.560329 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-1f239ce7-1e8f-49b0-b19d-e9229699f7e6 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031126 Sep 06 21:06:51.560955 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 13/26] 10.222.0.79 () {64 vars in 1333 bytes} [Tue Sep 6 21:06:51 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:06:54.206205 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-6c2a839c-c1b9-4a91-9f51-4679853c8982 admin admin] Calling method '>' {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:06:54.207411 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-6c2a839c-c1b9-4a91-9f51-4679853c8982 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001759 Sep 06 21:06:54.207907 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 14/27] 10.222.0.79 () {54 vars in 931 bytes} [Tue Sep 6 21:06:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:06:54.660138 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-2bf5d0d8-84d1-432e-a65e-4d3f9e6e0c2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "ram": 4096, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium"}} {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:06:54.683762 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-2bf5d0d8-84d1-432e-a65e-4d3f9e6e0c2b admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.468929 Sep 06 21:06:54.684425 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 14/28] 10.222.0.79 () {64 vars in 1283 bytes} [Tue Sep 6 21:06:54 2022] POST /compute/v2.1/flavors => generated 406 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 21:06:54.697116 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-3d6a0453-caea-4121-b7d0-3f9108b2242a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:06:54.727113 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-3d6a0453-caea-4121-b7d0-3f9108b2242a admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033801 Sep 06 21:06:54.737227 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 15/29] 10.222.0.79 () {64 vars in 1333 bytes} [Tue Sep 6 21:06:54 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:06:57.372446 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-2bf5d0d8-84d1-432e-a65e-4d3f9e6e0c2b admin admin] Calling method '>' {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:06:57.373501 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-2bf5d0d8-84d1-432e-a65e-4d3f9e6e0c2b admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Sep 06 21:06:57.374090 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 15/30] 10.222.0.79 () {54 vars in 931 bytes} [Tue Sep 6 21:06:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:06:57.817919 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-c1b93fd1-4e79-4ec5-9558-5e95ce3dd736 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192, "vcpus": 4, "disk": 80, "rxtx_factor": 1.0, "id": "4"}} {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:06:57.825387 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG dbcounter [-] [105712] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:57.844937 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-c1b93fd1-4e79-4ec5-9558-5e95ce3dd736 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.464712 Sep 06 21:06:57.845585 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 16/31] 10.222.0.79 () {64 vars in 1283 bytes} [Tue Sep 6 21:06:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 21:06:57.858263 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-6f477537-73e8-47a8-be30-a1fc1e493ed5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:06:57.884146 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-6f477537-73e8-47a8-be30-a1fc1e493ed5 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029896 Sep 06 21:06:57.885154 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 16/32] 10.222.0.79 () {64 vars in 1333 bytes} [Tue Sep 6 21:06:57 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:07:00.522889 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-c1b93fd1-4e79-4ec5-9558-5e95ce3dd736 admin admin] Calling method '>' {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:07:00.523908 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-c1b93fd1-4e79-4ec5-9558-5e95ce3dd736 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Sep 06 21:07:00.524311 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 17/33] 10.222.0.79 () {54 vars in 931 bytes} [Tue Sep 6 21:07:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:07:00.969292 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-78b8858d-32bf-49d1-bfb0-b6bfd21f6a4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "os-flavor-access:is_public": true, "name": "m1.xlarge", "disk": 160, "swap": 0, "rxtx_factor": 1.0, "id": "5", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:07:00.975731 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG dbcounter [-] [105711] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:07:00.992714 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-78b8858d-32bf-49d1-bfb0-b6bfd21f6a4a admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.461999 Sep 06 21:07:00.996720 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 17/34] 10.222.0.79 () {64 vars in 1283 bytes} [Tue Sep 6 21:07:00 2022] POST /compute/v2.1/flavors => generated 408 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 21:07:01.005888 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-7625d950-2b8c-43f3-8801-930701c8eaa0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:07:01.032225 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-7625d950-2b8c-43f3-8801-930701c8eaa0 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030293 Sep 06 21:07:01.036798 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 18/35] 10.222.0.79 () {64 vars in 1333 bytes} [Tue Sep 6 21:07:01 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:07:17.987877 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-78b8858d-32bf-49d1-bfb0-b6bfd21f6a4a admin admin] Calling method '>' {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:07:17.989116 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-78b8858d-32bf-49d1-bfb0-b6bfd21f6a4a admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002030 Sep 06 21:07:17.989699 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 18/36] 10.222.0.79 () {54 vars in 931 bytes} [Tue Sep 6 21:07:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:07:18.005130 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG dbcounter [-] [105712] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:07:18.467856 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-48dc0c1f-f2ab-4dc1-a8e5-88796ca1ad1c admin admin] Calling method '>' {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:07:18.495815 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-48dc0c1f-f2ab-4dc1-a8e5-88796ca1ad1c admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.498119 Sep 06 21:07:18.496394 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 19/37] 10.222.0.79 () {60 vars in 1292 bytes} [Tue Sep 6 21:07:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 21:07:19.835993 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-78b8858d-32bf-49d1-bfb0-b6bfd21f6a4a admin admin] Calling method '>' {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:07:19.837558 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-78b8858d-32bf-49d1-bfb0-b6bfd21f6a4a admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002020 Sep 06 21:07:19.837997 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 19/38] 10.222.0.79 () {56 vars in 1074 bytes} [Tue Sep 6 21:07:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:07:20.430957 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-2e3aaf33-985c-464e-bc01-c2c9f0464acf admin admin] Calling method '>' {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:07:20.437586 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.wsgi [None req-2e3aaf33-985c-464e-bc01-c2c9f0464acf admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 06 21:07:20.440899 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-2e3aaf33-985c-464e-bc01-c2c9f0464acf admin admin] Request method failure captured: Sep 06 21:07:20.440899 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 06 21:07:20.440899 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: Accept: application/json Sep 06 21:07:20.440899 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: Accept-Encoding: gzip, deflate Sep 06 21:07:20.440899 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: Connection: keep-alive Sep 06 21:07:20.440899 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: Content-Length: 0 Sep 06 21:07:20.440899 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: Host: 10.222.0.79 Sep 06 21:07:20.440899 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: Openstack-Api-Version: compute 2.92 Sep 06 21:07:20.440899 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: Openstack-System-Scope: None Sep 06 21:07:20.440899 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: User-Agent: python-novaclient Sep 06 21:07:20.440899 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Auth-Token: gAAAAABjF7aHveA5_4Tz7e9aPhVnawf0RuiPe3zjhafSN5bIlalVplz7bn2ctFWqG364Ur-acV7S9ke9E-bmm2upo4dEdo6TSJroiM3XVkfJE5ed2r_lRNXCGGhtnrSDN8iaQLSkf2J323_2Rfs0MByW64kRShu6UiovqLQR-OOSE9qjJIrr65E Sep 06 21:07:20.440899 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Domain-Id: None Sep 06 21:07:20.440899 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Domain-Name: None Sep 06 21:07:20.440899 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Identity-Status: Confirmed Sep 06 21:07:20.440899 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Is-Admin-Project: True Sep 06 21:07:20.440899 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 21:07:20.440899 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Project-Domain-Id: default Sep 06 21:07:20.440899 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Project-Domain-Name: Default Sep 06 21:07:20.440899 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Project-Id: 0b4b2ee27141432e8ca02dac223fb495 Sep 06 21:07:20.440899 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Project-Name: admin Sep 06 21:07:20.440899 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Role: reader,member,admin Sep 06 21:07:20.440899 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Roles: reader,member,admin Sep 06 21:07:20.442501 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0b4b2ee27141432e8ca02dac223fb495"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0b4b2ee27141432e8ca02dac223fb495", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b4b2ee27141432e8ca02dac223fb495"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b4b2ee27141432e8ca02dac223fb495"}]}] Sep 06 21:07:20.442501 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Tenant: admin Sep 06 21:07:20.442501 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Tenant-Id: 0b4b2ee27141432e8ca02dac223fb495 Sep 06 21:07:20.442501 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Tenant-Name: admin Sep 06 21:07:20.442501 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-User: admin Sep 06 21:07:20.442501 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-User-Domain-Id: default Sep 06 21:07:20.442501 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-User-Domain-Name: Default Sep 06 21:07:20.442501 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-User-Id: 42a19c5d3ad549648071d18e7300d6c1 Sep 06 21:07:20.442501 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-User-Name: admin Sep 06 21:07:20.442501 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: method: > Sep 06 21:07:20.442501 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: exception: Flavor 42 could not be found. Sep 06 21:07:20.442501 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: action_args: {'id': '42'} Sep 06 21:07:20.442501 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:07:20.442501 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:07:20.443429 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 21:07:20.443429 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 21:07:20.443429 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 21:07:20.443429 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 21:07:20.443429 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 21:07:20.443429 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 21:07:20.443429 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 21:07:20.443429 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 21:07:20.443429 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 21:07:20.443429 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:07:20.443429 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 21:07:20.443429 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 21:07:20.443429 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 06 21:07:20.443429 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi Sep 06 21:07:20.443429 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:07:20.443429 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi Sep 06 21:07:20.443429 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:07:20.443429 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:07:20.443429 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:07:20.444686 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:07:20.444686 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:07:20.444686 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:07:20.444686 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:07:20.444686 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 21:07:20.444686 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:07:20.444686 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 06 21:07:20.444686 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi Sep 06 21:07:20.444686 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:07:20.444686 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi Sep 06 21:07:20.444686 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:07:20.444686 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:07:20.444686 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:07:20.444686 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:07:20.444686 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:07:20.444686 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 06 21:07:20.444686 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi Sep 06 21:07:20.444686 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-2e3aaf33-985c-464e-bc01-c2c9f0464acf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:07:20.445904 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-2e3aaf33-985c-464e-bc01-c2c9f0464acf admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.460534 Sep 06 21:07:20.445904 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 20/39] 10.222.0.79 () {60 vars in 1190 bytes} [Tue Sep 6 21:07:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 462 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 21:07:20.452831 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-c6c1875e-e8e4-4c9c-ad4f-4fc1dcd9329b admin admin] Calling method '>' {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:07:20.475471 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-c6c1875e-e8e4-4c9c-ad4f-4fc1dcd9329b admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026612 Sep 06 21:07:20.476015 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 20/40] 10.222.0.79 () {60 vars in 1210 bytes} [Tue Sep 6 21:07:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:07:20.486474 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-5483aa36-cc49-4e4f-b984-00e06840d856 admin admin] Calling method '>' {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:07:20.511808 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-5483aa36-cc49-4e4f-b984-00e06840d856 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028889 Sep 06 21:07:20.512381 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 21/41] 10.222.0.79 () {60 vars in 1210 bytes} [Tue Sep 6 21:07:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:07:20.523889 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-5c1571ce-9f1e-455c-bda4-8fbf0eccd6ed admin admin] Calling method '>' {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:07:20.530232 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.wsgi [None req-5c1571ce-9f1e-455c-bda4-8fbf0eccd6ed admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 06 21:07:20.533514 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-5c1571ce-9f1e-455c-bda4-8fbf0eccd6ed admin admin] Request method failure captured: Sep 06 21:07:20.533514 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 06 21:07:20.533514 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: Accept: application/json Sep 06 21:07:20.533514 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: Accept-Encoding: gzip, deflate Sep 06 21:07:20.533514 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: Connection: keep-alive Sep 06 21:07:20.533514 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: Content-Length: 0 Sep 06 21:07:20.533514 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: Host: 10.222.0.79 Sep 06 21:07:20.533514 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: Openstack-Api-Version: compute 2.92 Sep 06 21:07:20.533514 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: Openstack-System-Scope: None Sep 06 21:07:20.533514 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: User-Agent: python-novaclient Sep 06 21:07:20.533514 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Auth-Token: gAAAAABjF7aHveA5_4Tz7e9aPhVnawf0RuiPe3zjhafSN5bIlalVplz7bn2ctFWqG364Ur-acV7S9ke9E-bmm2upo4dEdo6TSJroiM3XVkfJE5ed2r_lRNXCGGhtnrSDN8iaQLSkf2J323_2Rfs0MByW64kRShu6UiovqLQR-OOSE9qjJIrr65E Sep 06 21:07:20.533514 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Domain-Id: None Sep 06 21:07:20.533514 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Domain-Name: None Sep 06 21:07:20.533514 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Identity-Status: Confirmed Sep 06 21:07:20.533514 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Is-Admin-Project: True Sep 06 21:07:20.533514 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 21:07:20.533514 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Project-Domain-Id: default Sep 06 21:07:20.533514 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Project-Domain-Name: Default Sep 06 21:07:20.533514 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Project-Id: 0b4b2ee27141432e8ca02dac223fb495 Sep 06 21:07:20.533514 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Project-Name: admin Sep 06 21:07:20.533514 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Role: reader,member,admin Sep 06 21:07:20.533514 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Roles: reader,member,admin Sep 06 21:07:20.534972 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0b4b2ee27141432e8ca02dac223fb495"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0b4b2ee27141432e8ca02dac223fb495", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b4b2ee27141432e8ca02dac223fb495"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b4b2ee27141432e8ca02dac223fb495"}]}] Sep 06 21:07:20.534972 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Tenant: admin Sep 06 21:07:20.534972 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Tenant-Id: 0b4b2ee27141432e8ca02dac223fb495 Sep 06 21:07:20.534972 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Tenant-Name: admin Sep 06 21:07:20.534972 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-User: admin Sep 06 21:07:20.534972 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-User-Domain-Id: default Sep 06 21:07:20.534972 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-User-Domain-Name: Default Sep 06 21:07:20.534972 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-User-Id: 42a19c5d3ad549648071d18e7300d6c1 Sep 06 21:07:20.534972 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-User-Name: admin Sep 06 21:07:20.534972 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: method: > Sep 06 21:07:20.534972 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: exception: Flavor 42 could not be found. Sep 06 21:07:20.534972 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: action_args: {'id': '42'} Sep 06 21:07:20.534972 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:07:20.534972 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:07:20.535986 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 21:07:20.535986 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 21:07:20.535986 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 21:07:20.535986 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 21:07:20.535986 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 21:07:20.535986 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 21:07:20.535986 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 21:07:20.535986 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 21:07:20.535986 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 21:07:20.535986 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:07:20.535986 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 21:07:20.535986 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 21:07:20.535986 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 06 21:07:20.535986 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi Sep 06 21:07:20.535986 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:07:20.535986 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi Sep 06 21:07:20.535986 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:07:20.535986 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:07:20.535986 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:07:20.537588 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:07:20.537588 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:07:20.537588 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:07:20.537588 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:07:20.537588 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 21:07:20.537588 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:07:20.537588 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 06 21:07:20.537588 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi Sep 06 21:07:20.537588 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:07:20.537588 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi Sep 06 21:07:20.537588 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:07:20.537588 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:07:20.537588 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:07:20.537588 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:07:20.537588 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:07:20.537588 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 06 21:07:20.537588 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi Sep 06 21:07:20.537588 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-5c1571ce-9f1e-455c-bda4-8fbf0eccd6ed admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:07:20.539252 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-5c1571ce-9f1e-455c-bda4-8fbf0eccd6ed admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014913 Sep 06 21:07:20.539252 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 21/42] 10.222.0.79 () {60 vars in 1190 bytes} [Tue Sep 6 21:07:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 21:07:21.786374 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-5483aa36-cc49-4e4f-b984-00e06840d856 admin admin] Calling method '>' {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:07:21.787721 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-5483aa36-cc49-4e4f-b984-00e06840d856 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001973 Sep 06 21:07:21.788233 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 22/43] 10.222.0.79 () {56 vars in 1074 bytes} [Tue Sep 6 21:07:21 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:07:22.362088 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-8167f46a-6784-40be-9d45-7aac38bee5e5 admin admin] Calling method '>' {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:07:22.367598 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.wsgi [None req-8167f46a-6784-40be-9d45-7aac38bee5e5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 06 21:07:22.369240 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-8167f46a-6784-40be-9d45-7aac38bee5e5 admin admin] Request method failure captured: Sep 06 21:07:22.369240 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 06 21:07:22.369240 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: Accept: application/json Sep 06 21:07:22.369240 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: Accept-Encoding: gzip, deflate Sep 06 21:07:22.369240 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: Connection: keep-alive Sep 06 21:07:22.369240 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: Content-Length: 0 Sep 06 21:07:22.369240 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: Host: 10.222.0.79 Sep 06 21:07:22.369240 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: Openstack-Api-Version: compute 2.92 Sep 06 21:07:22.369240 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: Openstack-System-Scope: None Sep 06 21:07:22.369240 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: User-Agent: python-novaclient Sep 06 21:07:22.369240 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Auth-Token: gAAAAABjF7aJwtetLahFHAuNu_zkG71xniNtBH73XZuFfb7B-v7HB-16uzjZ5BKvJmLauA6OtDxUy0nL6A8xpTV6nwS7zEYs_4njcu0kNUnRa1U0yKQYEegxloCcnKxDabMmkkjbgl6DVUFpIWp6cKcau3oJ9KUux0al6NrzkmXKJlXxvX4m_Io Sep 06 21:07:22.369240 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Domain-Id: None Sep 06 21:07:22.369240 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Domain-Name: None Sep 06 21:07:22.369240 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Identity-Status: Confirmed Sep 06 21:07:22.369240 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Is-Admin-Project: True Sep 06 21:07:22.369240 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 21:07:22.369240 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Project-Domain-Id: default Sep 06 21:07:22.369240 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Project-Domain-Name: Default Sep 06 21:07:22.369240 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Project-Id: 0b4b2ee27141432e8ca02dac223fb495 Sep 06 21:07:22.369240 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Project-Name: admin Sep 06 21:07:22.369240 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Role: reader,member,admin Sep 06 21:07:22.369240 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Roles: reader,member,admin Sep 06 21:07:22.370831 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0b4b2ee27141432e8ca02dac223fb495"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0b4b2ee27141432e8ca02dac223fb495", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b4b2ee27141432e8ca02dac223fb495"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b4b2ee27141432e8ca02dac223fb495"}]}] Sep 06 21:07:22.370831 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Tenant: admin Sep 06 21:07:22.370831 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Tenant-Id: 0b4b2ee27141432e8ca02dac223fb495 Sep 06 21:07:22.370831 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Tenant-Name: admin Sep 06 21:07:22.370831 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-User: admin Sep 06 21:07:22.370831 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-User-Domain-Id: default Sep 06 21:07:22.370831 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-User-Domain-Name: Default Sep 06 21:07:22.370831 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-User-Id: 42a19c5d3ad549648071d18e7300d6c1 Sep 06 21:07:22.370831 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-User-Name: admin Sep 06 21:07:22.370831 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: method: > Sep 06 21:07:22.370831 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: exception: Flavor 84 could not be found. Sep 06 21:07:22.370831 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: action_args: {'id': '84'} Sep 06 21:07:22.370831 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:07:22.370831 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:07:22.371910 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 21:07:22.371910 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 21:07:22.371910 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 21:07:22.371910 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 21:07:22.371910 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 21:07:22.371910 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 21:07:22.371910 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 21:07:22.371910 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 21:07:22.371910 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 21:07:22.371910 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:07:22.371910 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 21:07:22.371910 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 21:07:22.371910 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 06 21:07:22.371910 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi Sep 06 21:07:22.371910 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:07:22.371910 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi Sep 06 21:07:22.371910 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:07:22.371910 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:07:22.371910 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:07:22.373599 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:07:22.373599 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:07:22.373599 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:07:22.373599 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:07:22.373599 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 21:07:22.373599 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:07:22.373599 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 06 21:07:22.373599 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi Sep 06 21:07:22.373599 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:07:22.373599 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi Sep 06 21:07:22.373599 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:07:22.373599 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:07:22.373599 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:07:22.373599 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:07:22.373599 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:07:22.373599 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 06 21:07:22.373599 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi Sep 06 21:07:22.373599 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-8167f46a-6784-40be-9d45-7aac38bee5e5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:07:22.374871 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-8167f46a-6784-40be-9d45-7aac38bee5e5 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.442802 Sep 06 21:07:22.374871 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 22/44] 10.222.0.79 () {60 vars in 1190 bytes} [Tue Sep 6 21:07:21 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 444 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 21:07:22.383371 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-ce2b6ecd-523e-4820-b42d-07cb6bb92685 admin admin] Calling method '>' {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:07:22.404175 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-ce2b6ecd-523e-4820-b42d-07cb6bb92685 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026876 Sep 06 21:07:22.404711 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 23/45] 10.222.0.79 () {60 vars in 1210 bytes} [Tue Sep 6 21:07:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:07:22.414432 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-b293bf01-22a6-4e41-a136-ec170f91b4a4 admin admin] Calling method '>' {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:07:22.429701 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-b293bf01-22a6-4e41-a136-ec170f91b4a4 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018833 Sep 06 21:07:22.430261 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 23/46] 10.222.0.79 () {60 vars in 1210 bytes} [Tue Sep 6 21:07:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:07:22.440221 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-1c349d0a-e42d-4dd4-b737-38ba605eee48 admin admin] Calling method '>' {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:07:22.445773 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.wsgi [None req-1c349d0a-e42d-4dd4-b737-38ba605eee48 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 06 21:07:22.447274 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-1c349d0a-e42d-4dd4-b737-38ba605eee48 admin admin] Request method failure captured: Sep 06 21:07:22.447274 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 06 21:07:22.447274 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: Accept: application/json Sep 06 21:07:22.447274 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: Accept-Encoding: gzip, deflate Sep 06 21:07:22.447274 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: Connection: keep-alive Sep 06 21:07:22.447274 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: Content-Length: 0 Sep 06 21:07:22.447274 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: Host: 10.222.0.79 Sep 06 21:07:22.447274 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: Openstack-Api-Version: compute 2.92 Sep 06 21:07:22.447274 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: Openstack-System-Scope: None Sep 06 21:07:22.447274 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: User-Agent: python-novaclient Sep 06 21:07:22.447274 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Auth-Token: gAAAAABjF7aJwtetLahFHAuNu_zkG71xniNtBH73XZuFfb7B-v7HB-16uzjZ5BKvJmLauA6OtDxUy0nL6A8xpTV6nwS7zEYs_4njcu0kNUnRa1U0yKQYEegxloCcnKxDabMmkkjbgl6DVUFpIWp6cKcau3oJ9KUux0al6NrzkmXKJlXxvX4m_Io Sep 06 21:07:22.447274 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Domain-Id: None Sep 06 21:07:22.447274 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Domain-Name: None Sep 06 21:07:22.447274 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Identity-Status: Confirmed Sep 06 21:07:22.447274 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Is-Admin-Project: True Sep 06 21:07:22.447274 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 21:07:22.447274 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Project-Domain-Id: default Sep 06 21:07:22.447274 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Project-Domain-Name: Default Sep 06 21:07:22.447274 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Project-Id: 0b4b2ee27141432e8ca02dac223fb495 Sep 06 21:07:22.447274 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Project-Name: admin Sep 06 21:07:22.447274 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Role: reader,member,admin Sep 06 21:07:22.447274 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Roles: reader,member,admin Sep 06 21:07:22.448971 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0b4b2ee27141432e8ca02dac223fb495"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0b4b2ee27141432e8ca02dac223fb495", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b4b2ee27141432e8ca02dac223fb495"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b4b2ee27141432e8ca02dac223fb495"}]}] Sep 06 21:07:22.448971 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Tenant: admin Sep 06 21:07:22.448971 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Tenant-Id: 0b4b2ee27141432e8ca02dac223fb495 Sep 06 21:07:22.448971 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Tenant-Name: admin Sep 06 21:07:22.448971 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-User: admin Sep 06 21:07:22.448971 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-User-Domain-Id: default Sep 06 21:07:22.448971 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-User-Domain-Name: Default Sep 06 21:07:22.448971 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-User-Id: 42a19c5d3ad549648071d18e7300d6c1 Sep 06 21:07:22.448971 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-User-Name: admin Sep 06 21:07:22.448971 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: method: > Sep 06 21:07:22.448971 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: exception: Flavor 84 could not be found. Sep 06 21:07:22.448971 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: action_args: {'id': '84'} Sep 06 21:07:22.448971 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:07:22.448971 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:07:22.449970 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 21:07:22.449970 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 21:07:22.449970 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 21:07:22.449970 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 21:07:22.449970 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 21:07:22.449970 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 21:07:22.449970 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 21:07:22.449970 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 21:07:22.449970 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 21:07:22.449970 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:07:22.449970 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 21:07:22.449970 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 21:07:22.449970 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 06 21:07:22.449970 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi Sep 06 21:07:22.449970 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:07:22.449970 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi Sep 06 21:07:22.449970 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:07:22.449970 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:07:22.449970 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:07:22.451642 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:07:22.451642 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:07:22.451642 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:07:22.451642 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:07:22.451642 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 21:07:22.451642 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:07:22.451642 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 06 21:07:22.451642 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi Sep 06 21:07:22.451642 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:07:22.451642 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi Sep 06 21:07:22.451642 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:07:22.451642 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:07:22.451642 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:07:22.451642 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:07:22.451642 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:07:22.451642 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 06 21:07:22.451642 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi Sep 06 21:07:22.451642 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-1c349d0a-e42d-4dd4-b737-38ba605eee48 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:07:22.452962 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-1c349d0a-e42d-4dd4-b737-38ba605eee48 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011954 Sep 06 21:07:22.452962 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 24/47] 10.222.0.79 () {60 vars in 1190 bytes} [Tue Sep 6 21:07:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 21:07:23.814176 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-b293bf01-22a6-4e41-a136-ec170f91b4a4 admin admin] Calling method '>' {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:07:23.815710 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-b293bf01-22a6-4e41-a136-ec170f91b4a4 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002262 Sep 06 21:07:23.816277 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 24/48] 10.222.0.79 () {56 vars in 1074 bytes} [Tue Sep 6 21:07:23 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:07:24.417229 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-0cefcf48-cc4d-4e77-92be-9b02be53fd9f admin admin] Calling method '>' {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:07:24.423286 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.wsgi [None req-0cefcf48-cc4d-4e77-92be-9b02be53fd9f admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 06 21:07:24.424860 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-0cefcf48-cc4d-4e77-92be-9b02be53fd9f admin admin] Request method failure captured: Sep 06 21:07:24.424860 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 06 21:07:24.424860 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: Accept: application/json Sep 06 21:07:24.424860 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: Accept-Encoding: gzip, deflate Sep 06 21:07:24.424860 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: Connection: keep-alive Sep 06 21:07:24.424860 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: Content-Length: 0 Sep 06 21:07:24.424860 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: Host: 10.222.0.79 Sep 06 21:07:24.424860 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: Openstack-Api-Version: compute 2.92 Sep 06 21:07:24.424860 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: Openstack-System-Scope: None Sep 06 21:07:24.424860 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: User-Agent: python-novaclient Sep 06 21:07:24.424860 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Auth-Token: gAAAAABjF7aLZSlyGGz_TFkKrJ16oIAUN0lBFoZC7TtVwxJM-l8dupA-BP6aUYaUbnUChaARtVW6ED8-GmG6oPQOVV3qiZwyez8twYDoYHUZiL1NcQFRmdinEqPdu3utU_f6LsJ6YFEI8XBK5JjmHQ79K96423njeFI_UkSoTy3hsKcfl5zmRrw Sep 06 21:07:24.424860 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Domain-Id: None Sep 06 21:07:24.424860 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Domain-Name: None Sep 06 21:07:24.424860 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Identity-Status: Confirmed Sep 06 21:07:24.424860 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Is-Admin-Project: True Sep 06 21:07:24.424860 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 21:07:24.424860 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Project-Domain-Id: default Sep 06 21:07:24.424860 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Project-Domain-Name: Default Sep 06 21:07:24.424860 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Project-Id: 0b4b2ee27141432e8ca02dac223fb495 Sep 06 21:07:24.424860 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Project-Name: admin Sep 06 21:07:24.424860 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Role: reader,member,admin Sep 06 21:07:24.424860 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Roles: reader,member,admin Sep 06 21:07:24.426198 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0b4b2ee27141432e8ca02dac223fb495"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0b4b2ee27141432e8ca02dac223fb495", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b4b2ee27141432e8ca02dac223fb495"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b4b2ee27141432e8ca02dac223fb495"}]}] Sep 06 21:07:24.426198 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Tenant: admin Sep 06 21:07:24.426198 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Tenant-Id: 0b4b2ee27141432e8ca02dac223fb495 Sep 06 21:07:24.426198 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-Tenant-Name: admin Sep 06 21:07:24.426198 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-User: admin Sep 06 21:07:24.426198 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-User-Domain-Id: default Sep 06 21:07:24.426198 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-User-Domain-Name: Default Sep 06 21:07:24.426198 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-User-Id: 42a19c5d3ad549648071d18e7300d6c1 Sep 06 21:07:24.426198 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: X-User-Name: admin Sep 06 21:07:24.426198 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: method: > Sep 06 21:07:24.426198 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: exception: Flavor 451 could not be found. Sep 06 21:07:24.426198 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: action_args: {'id': '451'} Sep 06 21:07:24.426198 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:07:24.426198 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:07:24.428165 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 21:07:24.428165 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 21:07:24.428165 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 21:07:24.428165 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 21:07:24.428165 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 21:07:24.428165 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 21:07:24.428165 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 21:07:24.428165 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 21:07:24.428165 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 21:07:24.428165 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:07:24.428165 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 21:07:24.428165 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 21:07:24.428165 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 06 21:07:24.428165 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi Sep 06 21:07:24.428165 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:07:24.428165 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi Sep 06 21:07:24.428165 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:07:24.428165 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:07:24.428165 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:07:24.429961 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:07:24.429961 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:07:24.429961 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:07:24.429961 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:07:24.429961 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 21:07:24.429961 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:07:24.429961 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 06 21:07:24.429961 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi Sep 06 21:07:24.429961 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:07:24.429961 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi Sep 06 21:07:24.429961 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:07:24.429961 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:07:24.429961 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:07:24.429961 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:07:24.429961 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:07:24.429961 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 06 21:07:24.429961 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: ERROR nova.api.openstack.wsgi Sep 06 21:07:24.429961 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-0cefcf48-cc4d-4e77-92be-9b02be53fd9f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:07:24.431268 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-0cefcf48-cc4d-4e77-92be-9b02be53fd9f admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.460767 Sep 06 21:07:24.431268 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 25/49] 10.222.0.79 () {60 vars in 1193 bytes} [Tue Sep 6 21:07:23 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 462 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 21:07:24.437796 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-fe5c5cab-833a-43ce-ab54-de9f8b94ce51 admin admin] Calling method '>' {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:07:24.453339 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-fe5c5cab-833a-43ce-ab54-de9f8b94ce51 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019140 Sep 06 21:07:24.453897 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 25/50] 10.222.0.79 () {60 vars in 1210 bytes} [Tue Sep 6 21:07:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:07:24.466217 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-4d49f057-4ac5-47d9-b392-38740cc98e29 admin admin] Calling method '>' {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:07:24.481881 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-4d49f057-4ac5-47d9-b392-38740cc98e29 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019268 Sep 06 21:07:24.482401 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 26/51] 10.222.0.79 () {60 vars in 1210 bytes} [Tue Sep 6 21:07:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:07:24.491870 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-b7743607-7a9a-445e-9f6e-bbd5d737a989 admin admin] Calling method '>' {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:07:24.497614 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.wsgi [None req-b7743607-7a9a-445e-9f6e-bbd5d737a989 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 06 21:07:24.499114 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-b7743607-7a9a-445e-9f6e-bbd5d737a989 admin admin] Request method failure captured: Sep 06 21:07:24.499114 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 06 21:07:24.499114 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: Accept: application/json Sep 06 21:07:24.499114 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: Accept-Encoding: gzip, deflate Sep 06 21:07:24.499114 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: Connection: keep-alive Sep 06 21:07:24.499114 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: Content-Length: 0 Sep 06 21:07:24.499114 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: Host: 10.222.0.79 Sep 06 21:07:24.499114 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: Openstack-Api-Version: compute 2.92 Sep 06 21:07:24.499114 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: Openstack-System-Scope: None Sep 06 21:07:24.499114 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: User-Agent: python-novaclient Sep 06 21:07:24.499114 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Auth-Token: gAAAAABjF7aLZSlyGGz_TFkKrJ16oIAUN0lBFoZC7TtVwxJM-l8dupA-BP6aUYaUbnUChaARtVW6ED8-GmG6oPQOVV3qiZwyez8twYDoYHUZiL1NcQFRmdinEqPdu3utU_f6LsJ6YFEI8XBK5JjmHQ79K96423njeFI_UkSoTy3hsKcfl5zmRrw Sep 06 21:07:24.499114 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Domain-Id: None Sep 06 21:07:24.499114 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Domain-Name: None Sep 06 21:07:24.499114 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Identity-Status: Confirmed Sep 06 21:07:24.499114 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Is-Admin-Project: True Sep 06 21:07:24.499114 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 21:07:24.499114 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Project-Domain-Id: default Sep 06 21:07:24.499114 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Project-Domain-Name: Default Sep 06 21:07:24.499114 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Project-Id: 0b4b2ee27141432e8ca02dac223fb495 Sep 06 21:07:24.499114 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Project-Name: admin Sep 06 21:07:24.499114 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Role: reader,member,admin Sep 06 21:07:24.499114 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Roles: reader,member,admin Sep 06 21:07:24.500452 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0b4b2ee27141432e8ca02dac223fb495"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0b4b2ee27141432e8ca02dac223fb495", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b4b2ee27141432e8ca02dac223fb495"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b4b2ee27141432e8ca02dac223fb495"}]}] Sep 06 21:07:24.500452 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Tenant: admin Sep 06 21:07:24.500452 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Tenant-Id: 0b4b2ee27141432e8ca02dac223fb495 Sep 06 21:07:24.500452 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-Tenant-Name: admin Sep 06 21:07:24.500452 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-User: admin Sep 06 21:07:24.500452 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-User-Domain-Id: default Sep 06 21:07:24.500452 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-User-Domain-Name: Default Sep 06 21:07:24.500452 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-User-Id: 42a19c5d3ad549648071d18e7300d6c1 Sep 06 21:07:24.500452 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: X-User-Name: admin Sep 06 21:07:24.500452 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: method: > Sep 06 21:07:24.500452 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: exception: Flavor 451 could not be found. Sep 06 21:07:24.500452 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: action_args: {'id': '451'} Sep 06 21:07:24.500452 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:07:24.500452 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:07:24.501512 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 21:07:24.501512 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 21:07:24.501512 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 21:07:24.501512 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 21:07:24.501512 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 21:07:24.501512 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 21:07:24.501512 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 21:07:24.501512 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 21:07:24.501512 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 21:07:24.501512 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:07:24.501512 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 21:07:24.501512 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 21:07:24.501512 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 06 21:07:24.501512 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi Sep 06 21:07:24.501512 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:07:24.501512 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi Sep 06 21:07:24.501512 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:07:24.501512 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:07:24.501512 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:07:24.502860 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:07:24.502860 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:07:24.502860 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:07:24.502860 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:07:24.502860 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 21:07:24.502860 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:07:24.502860 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 06 21:07:24.502860 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi Sep 06 21:07:24.502860 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:07:24.502860 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi Sep 06 21:07:24.502860 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:07:24.502860 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:07:24.502860 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:07:24.502860 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:07:24.502860 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:07:24.502860 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 06 21:07:24.502860 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: ERROR nova.api.openstack.wsgi Sep 06 21:07:24.502860 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-b7743607-7a9a-445e-9f6e-bbd5d737a989 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:07:24.504084 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-b7743607-7a9a-445e-9f6e-bbd5d737a989 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012242 Sep 06 21:07:24.504084 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 26/52] 10.222.0.79 () {60 vars in 1193 bytes} [Tue Sep 6 21:07:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 06 21:07:25.762995 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-4d49f057-4ac5-47d9-b392-38740cc98e29 admin admin] Calling method '>' {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:07:25.764047 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-4d49f057-4ac5-47d9-b392-38740cc98e29 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Sep 06 21:07:25.764448 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 27/53] 10.222.0.79 () {56 vars in 1074 bytes} [Tue Sep 6 21:07:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:07:26.355829 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-b943a5e5-418e-4b9a-acfc-0bb702373c73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:07:26.378136 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-b943a5e5-418e-4b9a-acfc-0bb702373c73 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.477459 Sep 06 21:07:26.378675 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 27/54] 10.222.0.79 () {64 vars in 1235 bytes} [Tue Sep 6 21:07:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 21:07:27.623278 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-4d49f057-4ac5-47d9-b392-38740cc98e29 admin admin] Calling method '>' {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:07:27.624602 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-4d49f057-4ac5-47d9-b392-38740cc98e29 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001675 Sep 06 21:07:27.625147 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 28/55] 10.222.0.79 () {56 vars in 1074 bytes} [Tue Sep 6 21:07:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:07:28.214820 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-ae4e2999-907c-471f-af94-f0c57d52586f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:07:28.242141 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-ae4e2999-907c-471f-af94-f0c57d52586f admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.476296 Sep 06 21:07:28.242887 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 28/56] 10.222.0.79 () {64 vars in 1235 bytes} [Tue Sep 6 21:07:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 21:07:29.482256 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-4d49f057-4ac5-47d9-b392-38740cc98e29 admin admin] Calling method '>' {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:07:29.483263 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-4d49f057-4ac5-47d9-b392-38740cc98e29 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Sep 06 21:07:29.483649 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 29/57] 10.222.0.79 () {56 vars in 1074 bytes} [Tue Sep 6 21:07:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:07:30.057268 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-0af4a74f-40c3-433a-8fff-57b514e8f2df admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:07:30.080561 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-0af4a74f-40c3-433a-8fff-57b514e8f2df admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.455821 Sep 06 21:07:30.081136 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 29/58] 10.222.0.79 () {64 vars in 1235 bytes} [Tue Sep 6 21:07:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 21:07:31.339021 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-4d49f057-4ac5-47d9-b392-38740cc98e29 admin admin] Calling method '>' {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:07:31.340036 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-4d49f057-4ac5-47d9-b392-38740cc98e29 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 06 21:07:31.340428 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 30/59] 10.222.0.79 () {56 vars in 1074 bytes} [Tue Sep 6 21:07:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 21:07:31.902943 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-f5e1a43b-99f8-4851-8b83-237ffeb53b45 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:07:31.922868 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-f5e1a43b-99f8-4851-8b83-237ffeb53b45 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.446301 Sep 06 21:07:31.923419 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 30/60] 10.222.0.79 () {64 vars in 1235 bytes} [Tue Sep 6 21:07:31 2022] POST /compute/v2.1/flavors => generated 409 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 21:07:33.183245 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-4d49f057-4ac5-47d9-b392-38740cc98e29 admin admin] Calling method '>' {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:07:33.184612 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-4d49f057-4ac5-47d9-b392-38740cc98e29 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002342 Sep 06 21:07:33.185096 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 31/61] 10.222.0.79 () {56 vars in 1074 bytes} [Tue Sep 6 21:07:33 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:07:33.765704 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-3a03768b-e167-4e3c-9568-747ee2bcd7cc admin admin] Calling method '>' {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:07:33.787924 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-3a03768b-e167-4e3c-9568-747ee2bcd7cc admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.466705 Sep 06 21:07:33.788467 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 31/62] 10.222.0.79 () {60 vars in 1202 bytes} [Tue Sep 6 21:07:33 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:08:31.537592 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-4d49f057-4ac5-47d9-b392-38740cc98e29 admin admin] Calling method '>' {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:08:31.540401 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-4d49f057-4ac5-47d9-b392-38740cc98e29 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003502 Sep 06 21:08:31.541048 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 32/63] 10.222.0.79 () {54 vars in 931 bytes} [Tue Sep 6 21:08:31 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:08:31.552919 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG dbcounter [-] [105711] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:08:31.988901 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-38600981-315d-4a8f-bb6c-b28d3b8db103 admin admin] Calling method '>' {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:08:32.011709 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-38600981-315d-4a8f-bb6c-b28d3b8db103 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.460403 Sep 06 21:08:32.012263 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 32/64] 10.222.0.79 () {60 vars in 1292 bytes} [Tue Sep 6 21:08:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:08:32.034663 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG dbcounter [-] [105712] Writing DB stats nova_api:SELECT=14 {{(pid=105712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:08:32.040867 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-8741ff7f-2880-4135-9cb7-02dd3e0b6a77 admin admin] Calling method '>' {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:08:32.053549 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-8741ff7f-2880-4135-9cb7-02dd3e0b6a77 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.021015 Sep 06 21:08:32.054368 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 33/65] 10.222.0.79 () {60 vars in 1283 bytes} [Tue Sep 6 21:08:32 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:08:32.069494 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-020fd352-f55c-4f2a-b3da-443e5c6ecfe7 admin admin] Calling method '>' {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:08:32.081662 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-020fd352-f55c-4f2a-b3da-443e5c6ecfe7 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017776 Sep 06 21:08:32.082439 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 33/66] 10.222.0.79 () {60 vars in 1286 bytes} [Tue Sep 6 21:08:32 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:08:32.098323 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-469abf3e-c783-451c-ab17-d10f0ca39117 admin admin] Calling method '>' {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:08:32.106478 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-469abf3e-c783-451c-ab17-d10f0ca39117 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011852 Sep 06 21:08:32.106997 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 34/67] 10.222.0.79 () {60 vars in 1286 bytes} [Tue Sep 6 21:08:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:08:32.122433 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-c3b0e55f-bead-458c-adaa-4c55f43dc8ab admin admin] Calling method '>' {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:08:32.130121 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-c3b0e55f-bead-458c-adaa-4c55f43dc8ab admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011373 Sep 06 21:08:32.130636 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 34/68] 10.222.0.79 () {60 vars in 1283 bytes} [Tue Sep 6 21:08:32 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:11:45.228303 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-469abf3e-c783-451c-ab17-d10f0ca39117 admin admin] Calling method '>' {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:11:45.229378 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-469abf3e-c783-451c-ab17-d10f0ca39117 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Sep 06 21:11:45.229795 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 35/69] 10.222.0.79 () {56 vars in 1074 bytes} [Tue Sep 6 21:11:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:11:45.367668 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG dbcounter [-] [105711] Writing DB stats nova_api:SELECT=6 {{(pid=105711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:11:45.534525 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-91c0b90f-7e7c-416e-9316-5426a7e63abc admin admin] Calling method '>' {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:11:45.538051 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_concurrency.lockutils [None req-91c0b90f-7e7c-416e-9316-5426a7e63abc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:11:45.538555 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_concurrency.lockutils [None req-91c0b90f-7e7c-416e-9316-5426a7e63abc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:11:45.538980 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_concurrency.lockutils [None req-91c0b90f-7e7c-416e-9316-5426a7e63abc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:11:45.539694 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_concurrency.lockutils [None req-91c0b90f-7e7c-416e-9316-5426a7e63abc admin admin] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:11:45.540131 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_concurrency.lockutils [None req-91c0b90f-7e7c-416e-9316-5426a7e63abc admin admin] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:11:45.540544 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_concurrency.lockutils [None req-91c0b90f-7e7c-416e-9316-5426a7e63abc admin admin] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:11:45.574933 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-91c0b90f-7e7c-416e-9316-5426a7e63abc admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.208658 Sep 06 21:11:45.575488 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 35/70] 10.222.0.79 () {60 vars in 1193 bytes} [Tue Sep 6 21:11:45 2022] GET /compute/v2.1/os-services => generated 794 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 21:11:46.692528 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-469abf3e-c783-451c-ab17-d10f0ca39117 admin admin] Calling method '>' {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:11:46.693594 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-469abf3e-c783-451c-ab17-d10f0ca39117 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Sep 06 21:11:46.693983 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 36/71] 10.222.0.79 () {56 vars in 1074 bytes} [Tue Sep 6 21:11:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:11:46.902043 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-6264e1e0-cd32-4d23-994d-6101e7fbe2dd admin admin] Calling method '>' {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:11:46.905532 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_concurrency.lockutils [None req-6264e1e0-cd32-4d23-994d-6101e7fbe2dd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:11:46.906005 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_concurrency.lockutils [None req-6264e1e0-cd32-4d23-994d-6101e7fbe2dd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:11:46.906417 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_concurrency.lockutils [None req-6264e1e0-cd32-4d23-994d-6101e7fbe2dd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:11:46.907126 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_concurrency.lockutils [None req-6264e1e0-cd32-4d23-994d-6101e7fbe2dd admin admin] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:11:46.907552 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_concurrency.lockutils [None req-6264e1e0-cd32-4d23-994d-6101e7fbe2dd admin admin] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:11:46.907959 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_concurrency.lockutils [None req-6264e1e0-cd32-4d23-994d-6101e7fbe2dd admin admin] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:11:46.929017 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-6264e1e0-cd32-4d23-994d-6101e7fbe2dd admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.094522 Sep 06 21:11:46.929566 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 36/72] 10.222.0.79 () {60 vars in 1193 bytes} [Tue Sep 6 21:11:46 2022] GET /compute/v2.1/os-services => generated 794 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 21:11:58.456705 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-469abf3e-c783-451c-ab17-d10f0ca39117 admin admin] Calling method '>' {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:11:58.458009 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-469abf3e-c783-451c-ab17-d10f0ca39117 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001908 Sep 06 21:11:58.458540 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 37/73] 10.222.0.79 () {56 vars in 1074 bytes} [Tue Sep 6 21:11:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:11:58.604589 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG dbcounter [-] [105711] Writing DB stats nova_cell0:SELECT=4 {{(pid=105711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:11:58.605447 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG dbcounter [-] [105711] Writing DB stats nova_cell1:SELECT=4 {{(pid=105711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:11:58.606398 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG dbcounter [-] [105711] Writing DB stats nova_api:SELECT=8 {{(pid=105711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:11:58.664244 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-f79a5625-95ca-4a3e-ade0-afc755019a6b admin admin] Calling method '>' {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:11:58.667627 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_concurrency.lockutils [None req-f79a5625-95ca-4a3e-ade0-afc755019a6b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:11:58.668112 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_concurrency.lockutils [None req-f79a5625-95ca-4a3e-ade0-afc755019a6b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:11:58.668539 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_concurrency.lockutils [None req-f79a5625-95ca-4a3e-ade0-afc755019a6b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:11:58.669284 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_concurrency.lockutils [None req-f79a5625-95ca-4a3e-ade0-afc755019a6b admin admin] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:11:58.669729 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_concurrency.lockutils [None req-f79a5625-95ca-4a3e-ade0-afc755019a6b admin admin] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:11:58.670167 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_concurrency.lockutils [None req-f79a5625-95ca-4a3e-ade0-afc755019a6b admin admin] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:11:58.696886 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-f79a5625-95ca-4a3e-ade0-afc755019a6b admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.097071 Sep 06 21:11:58.697444 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 37/74] 10.222.0.79 () {60 vars in 1193 bytes} [Tue Sep 6 21:11:58 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:11:59.797158 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: DEBUG nova.api.openstack.wsgi [None req-469abf3e-c783-451c-ab17-d10f0ca39117 admin admin] Calling method '>' {{(pid=105712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:11:59.798187 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: INFO nova.api.openstack.requestlog [None req-469abf3e-c783-451c-ab17-d10f0ca39117 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Sep 06 21:11:59.798575 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: [pid: 105712|app: 0|req: 38/75] 10.222.0.79 () {56 vars in 1074 bytes} [Tue Sep 6 21:11:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:11:59.993004 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG nova.api.openstack.wsgi [None req-db1c5c0a-07a6-42ab-bead-b3120c00cbed admin admin] Calling method '>' {{(pid=105711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:11:59.996360 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_concurrency.lockutils [None req-db1c5c0a-07a6-42ab-bead-b3120c00cbed admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:11:59.996872 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_concurrency.lockutils [None req-db1c5c0a-07a6-42ab-bead-b3120c00cbed admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:11:59.997300 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_concurrency.lockutils [None req-db1c5c0a-07a6-42ab-bead-b3120c00cbed admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:11:59.998017 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_concurrency.lockutils [None req-db1c5c0a-07a6-42ab-bead-b3120c00cbed admin admin] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:11:59.998479 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_concurrency.lockutils [None req-db1c5c0a-07a6-42ab-bead-b3120c00cbed admin admin] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:11:59.998966 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: DEBUG oslo_concurrency.lockutils [None req-db1c5c0a-07a6-42ab-bead-b3120c00cbed admin admin] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:12:00.020425 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: INFO nova.api.openstack.requestlog [None req-db1c5c0a-07a6-42ab-bead-b3120c00cbed admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.083623 Sep 06 21:12:00.021028 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: [pid: 105711|app: 0|req: 38/76] 10.222.0.79 () {60 vars in 1193 bytes} [Tue Sep 6 21:11:59 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:12:58.761490 dv-cinder-749155-11-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 06 21:12:58.762652 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: Tue Sep 6 21:12:58 2022 - graceful shutdown triggered... Sep 06 21:12:58.763152 dv-cinder-749155-11-iscsi devstack@n-api.service[105711]: Gracefully killing worker 1 (pid: 105711)... Sep 06 21:12:58.763619 dv-cinder-749155-11-iscsi devstack@n-api.service[105712]: Gracefully killing worker 2 (pid: 105712)... Sep 06 21:12:59.763748 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: worker 1 buried after 1 seconds Sep 06 21:12:59.763748 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: worker 2 buried after 1 seconds Sep 06 21:12:59.763748 dv-cinder-749155-11-iscsi devstack@n-api.service[105710]: goodbye to uWSGI. Sep 06 21:12:59.765417 dv-cinder-749155-11-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 06 21:12:59.766025 dv-cinder-749155-11-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 06 21:12:59.768935 dv-cinder-749155-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 06 21:12:59.779792 dv-cinder-749155-11-iscsi devstack@n-api.service[120707]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 06 21:12:59.781786 dv-cinder-749155-11-iscsi devstack@n-api.service[120707]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 6 21:12:59 2022] *** Sep 06 21:12:59.781786 dv-cinder-749155-11-iscsi devstack@n-api.service[120707]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 06 21:12:59.781786 dv-cinder-749155-11-iscsi devstack@n-api.service[120707]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 06 21:12:59.781786 dv-cinder-749155-11-iscsi devstack@n-api.service[120707]: nodename: dv-cinder-749155-11-iscsi Sep 06 21:12:59.781786 dv-cinder-749155-11-iscsi devstack@n-api.service[120707]: machine: x86_64 Sep 06 21:12:59.781786 dv-cinder-749155-11-iscsi devstack@n-api.service[120707]: clock source: unix Sep 06 21:12:59.781786 dv-cinder-749155-11-iscsi devstack@n-api.service[120707]: pcre jit disabled Sep 06 21:12:59.781786 dv-cinder-749155-11-iscsi devstack@n-api.service[120707]: detected number of CPU cores: 4 Sep 06 21:12:59.781786 dv-cinder-749155-11-iscsi devstack@n-api.service[120707]: current working directory: / Sep 06 21:12:59.781786 dv-cinder-749155-11-iscsi devstack@n-api.service[120707]: detected binary path: /usr/bin/uwsgi-core Sep 06 21:12:59.781786 dv-cinder-749155-11-iscsi devstack@n-api.service[120707]: your processes number limit is 47680 Sep 06 21:12:59.781786 dv-cinder-749155-11-iscsi devstack@n-api.service[120707]: your memory page size is 4096 bytes Sep 06 21:12:59.781786 dv-cinder-749155-11-iscsi devstack@n-api.service[120707]: detected max file descriptor number: 2048 Sep 06 21:12:59.781786 dv-cinder-749155-11-iscsi devstack@n-api.service[120707]: lock engine: pthread robust mutexes Sep 06 21:12:59.782679 dv-cinder-749155-11-iscsi devstack@n-api.service[120707]: thunder lock: enabled Sep 06 21:12:59.782679 dv-cinder-749155-11-iscsi devstack@n-api.service[120707]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 06 21:12:59.782679 dv-cinder-749155-11-iscsi devstack@n-api.service[120707]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 06 21:12:59.821012 dv-cinder-749155-11-iscsi devstack@n-api.service[120707]: Python main interpreter initialized at 0x55b43f2709c0 Sep 06 21:12:59.821012 dv-cinder-749155-11-iscsi devstack@n-api.service[120707]: python threads support enabled Sep 06 21:12:59.821012 dv-cinder-749155-11-iscsi devstack@n-api.service[120707]: your server socket listen backlog is limited to 100 connections Sep 06 21:12:59.821012 dv-cinder-749155-11-iscsi devstack@n-api.service[120707]: your mercy for graceful operations on workers is 90 seconds Sep 06 21:12:59.821477 dv-cinder-749155-11-iscsi devstack@n-api.service[120707]: mapped 403077 bytes (393 KB) for 2 cores Sep 06 21:12:59.821477 dv-cinder-749155-11-iscsi devstack@n-api.service[120707]: *** Operational MODE: preforking *** Sep 06 21:12:59.821712 dv-cinder-749155-11-iscsi devstack@n-api.service[120707]: *** uWSGI is running in multiple interpreter mode *** Sep 06 21:12:59.821712 dv-cinder-749155-11-iscsi devstack@n-api.service[120707]: spawned uWSGI master process (pid: 120707) Sep 06 21:12:59.821938 dv-cinder-749155-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 06 21:12:59.822472 dv-cinder-749155-11-iscsi devstack@n-api.service[120707]: spawned uWSGI worker 1 (pid: 120719, cores: 1) Sep 06 21:12:59.822826 dv-cinder-749155-11-iscsi devstack@n-api.service[120707]: spawned uWSGI worker 2 (pid: 120720, cores: 1) Sep 06 21:12:59.822980 dv-cinder-749155-11-iscsi devstack@n-api.service[120707]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 06 21:13:00.486401 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 21:13:00.495761 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 21:13:01.644008 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 21:13:01.644008 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: from cryptography.utils import int_from_bytes Sep 06 21:13:01.645084 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 21:13:01.645084 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: from cryptography.utils import int_from_bytes Sep 06 21:13:01.645462 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 21:13:01.645462 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: from cryptography.utils import int_from_bytes Sep 06 21:13:01.645914 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 21:13:01.645914 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: from cryptography.utils import int_from_bytes Sep 06 21:13:04.062393 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 21:13:04.062971 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 21:13:04.063283 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 21:13:04.063564 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 21:13:04.063823 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 21:13:04.064219 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.064551 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.064900 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.065221 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.065554 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.067568 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.067568 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.067568 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.067568 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.067568 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.067568 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.068402 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-749155-11-iscsi {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.068402 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.068544 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.068875 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.069201 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.069511 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.069836 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.070190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.070749 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.072127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.072127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.072323 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.072534 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.072871 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.073202 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.073518 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.073827 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.074146 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.074472 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.074873 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-749155-11-iscsi {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.075205 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.075509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.075833 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.076264 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.076590 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.076914 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.077303 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.077553 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.077870 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 21:13:04.078327 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.078441 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 21:13:04.078515 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.078515 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.078704 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 21:13:04.078995 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.079240 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 21:13:04.079429 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.079612 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 21:13:04.079798 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.079957 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.080139 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.080339 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.080486 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.080634 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.080861 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.080861 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.081152 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.081329 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.081484 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.081627 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.081778 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.081958 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.082106 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.082329 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.082489 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.082631 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.082781 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.082962 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.083131 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.083295 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.083447 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.083598 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.083598 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.083909 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-749155-11-iscsi {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.084067 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.084227 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.084412 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.084573 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.084757 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.084922 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.085088 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.085271 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.085420 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.085579 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.085731 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.085892 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.086077 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.086249 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.086394 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.086394 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.086701 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.086920 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.087113 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.087267 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.087417 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.087567 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.087721 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.087876 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.088020 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.088486 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.088647 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.088647 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.089021 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.089021 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.089704 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.089704 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.090055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.090219 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.090454 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.090610 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.090760 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.090760 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.091076 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-749155-11-iscsi {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.091242 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.091396 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.091607 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.091757 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.091899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.092061 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.092248 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.092483 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.093067 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.093323 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.093564 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.093825 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.094116 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.094371 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.094612 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.094864 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.095107 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.095397 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.095568 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.095724 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.095869 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.096023 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.096174 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.096327 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.096567 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.096764 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.096984 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.097234 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.097395 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.097556 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.097720 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.097873 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.098017 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.098017 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.098609 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.098768 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.098922 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.099157 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.099313 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.099313 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.099629 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.100017 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.100169 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.100336 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.100492 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.100492 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.100825 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.100977 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.101128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.101276 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.101426 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.101426 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.101718 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.101865 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.102029 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.102216 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.102371 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.102527 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.102682 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.102826 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.102987 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.103138 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.103288 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.103431 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.103573 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.103764 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.104167 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.104421 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.104621 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.104805 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.104951 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.105103 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.105261 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.105413 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.105565 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.105565 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.105844 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.106004 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.106160 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.106304 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.106467 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.106611 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.106762 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.106921 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.107076 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.107262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.107410 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.107552 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.107695 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.107847 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.108048 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.108205 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.108366 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.108827 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.108827 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.109185 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.109346 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.109497 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.109641 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.109792 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.109949 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.110368 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.110526 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.110680 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.110831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.110995 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.111150 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.111322 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.111598 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.111766 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.111911 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.112062 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.112244 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.112398 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.112584 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.112814 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.112959 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.113112 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.113279 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.113434 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.113579 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.113721 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.113879 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.114036 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.114199 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.114343 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.114485 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.114647 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.114805 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.114999 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.115159 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.115335 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.115488 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.115634 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.115777 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.115938 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.116090 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.116090 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.116370 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.116520 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.116727 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.116896 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.116896 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.117191 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.117342 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.117342 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.117622 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.117775 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.117933 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.118085 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.118228 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.118415 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.118577 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.118577 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.119230 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.119380 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.119535 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.119698 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.119852 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.120004 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.120147 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.120557 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.120761 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.120921 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.120921 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.121201 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.121344 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.121642 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.121801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.121964 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.122109 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.122251 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.122402 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.122631 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.122784 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.122938 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.123088 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.123232 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.123418 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.123565 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.123726 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.123888 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.124039 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.124190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.124349 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.124502 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.124749 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.124900 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.125053 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.125197 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.125359 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.125514 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.125658 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.125811 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.125978 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.126132 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.126284 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.126438 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.126590 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.126773 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.126920 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.127070 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.127223 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.127377 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.127528 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.127671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.127814 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.127975 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.128181 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.128341 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.128494 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.128638 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.128837 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.129320 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.129485 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.129630 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.129781 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:13:04.129932 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.130084 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.130228 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.130394 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.130824 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.130976 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.131135 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.131289 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.131440 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.131612 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.131848 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.132002 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.132147 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.132297 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.132451 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.132614 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.132781 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.132926 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.133085 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.133238 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.133396 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.133546 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.133699 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.133842 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.133996 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.134149 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.134305 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.134499 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.134671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.134823 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.134976 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.135120 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.135286 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.135440 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.135585 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.135585 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.135867 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.136023 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.136174 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.136318 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.136318 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.136600 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.136907 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.136907 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.137220 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.137365 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.137507 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.137659 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.137659 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.137963 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.138108 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.138251 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.138400 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.138550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.138712 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.138870 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.139016 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.139456 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.139607 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.139753 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.139905 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.140057 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.140216 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.140361 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.140510 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.140677 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.141114 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.141274 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.141426 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.141426 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.141723 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.141887 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.142137 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.142287 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.142431 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.142579 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.142731 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.142875 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.143039 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.143195 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.143339 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.143496 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.143644 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.143833 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.143991 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.144135 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.144279 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.144428 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.144580 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.144778 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.144935 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.145086 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.145242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.145394 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.145537 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.145695 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.145841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.145986 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.146159 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.146315 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.146468 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.146624 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.146769 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.146918 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.147064 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.147219 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.147363 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.147521 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.147666 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.147815 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.147961 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.148111 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.148270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.148421 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.148573 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.148750 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.148914 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.149071 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.149245 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.149618 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.149777 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.149931 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.150076 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.150227 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.150459 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.150660 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.150813 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.150958 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.151407 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.151568 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.151745 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.151935 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.152111 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.152355 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.152503 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.152789 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.152984 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.153139 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.153284 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.153437 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.153580 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.153733 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.153935 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.154099 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.154252 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.154406 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.154559 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.154714 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.154866 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.155010 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.155154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.155298 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.155452 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.155650 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.155795 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.155939 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.156092 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.156235 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.156388 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.156533 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.156695 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.156844 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.157000 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.157153 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.157306 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.157458 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.157610 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.157762 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.157926 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.158071 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.158229 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.158382 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.158524 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.158667 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.158816 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.158959 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.159112 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.159257 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.159438 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.159885 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.160038 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.160208 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.160360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.160512 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.160675 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.160838 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.160983 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.161141 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.161310 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.161735 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.161888 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.162031 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.162182 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.162354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.162623 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.162780 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.162933 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.163091 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.163251 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.163408 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.163564 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.163718 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.163870 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.164021 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.164175 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.164320 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.164463 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.164624 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.164849 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.165005 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.165164 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.165308 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.165458 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.165761 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.165921 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.166067 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.166220 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.166366 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.166509 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.166709 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.166859 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.167011 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.167172 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.167334 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.167478 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.167629 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.167780 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.167924 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.168081 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.168232 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.168377 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.168527 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.168700 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.168863 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.169043 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.169199 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.169343 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.169487 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.169631 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.169800 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.170130 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.170277 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.170428 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.170580 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.170725 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.170894 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.171039 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.171183 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.171334 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.171479 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.171947 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.172109 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.172266 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.172416 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.172567 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.172855 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.173016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.173171 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.173171 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.173455 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.173597 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.173748 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.173906 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.174051 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.174201 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.174357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.174509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.174653 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.174809 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.174961 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.175150 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.175306 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.175885 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.176037 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.176191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.176337 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.176490 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.176490 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.176798 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.176961 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.176961 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.177251 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.177401 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.177547 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.177700 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.177700 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.177988 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.178138 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.178282 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.178282 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.178572 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.178729 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.178873 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.179016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.179158 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.179308 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.179462 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.179617 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.179760 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.179904 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.180277 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.180430 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.180576 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.180741 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.180889 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.181045 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.181212 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.181365 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.181509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.181664 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.181832 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.182179 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.182344 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.182499 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.182650 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.182856 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.183104 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.183262 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.183418 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.183571 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.183730 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.183883 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.184046 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.184201 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.184345 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.184345 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.184720 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.184885 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.185075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.185239 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.185385 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.185528 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.185679 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.185824 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.185992 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.186159 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.186307 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.186446 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.186584 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.186721 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.186874 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.187020 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.187158 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.187304 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.187449 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.187595 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.187781 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.187931 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.188084 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.188221 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.188373 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.188518 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.188686 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.188844 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.188985 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.189137 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.189275 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.189412 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.189561 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.189698 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.189851 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.190003 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.190284 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.190486 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.190734 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.190896 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.191069 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.191206 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.191343 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.191493 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.191631 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.191775 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.191912 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.192059 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.192462 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.192618 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.192926 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.193196 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.193341 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.193501 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.193651 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.193802 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.193940 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.194090 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.194237 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.194388 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.194568 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.194719 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.194869 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.195015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.195154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.195304 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.195462 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.195601 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.195601 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.195875 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.195875 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.195875 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.196292 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.196439 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.196577 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.196828 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.196968 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.197124 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.197124 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.197521 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.197658 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.197795 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.197945 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.197945 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.198222 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.198383 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.198520 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.198667 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.198667 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.198950 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.201429 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.201429 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.201754 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.201921 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.202061 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.202200 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.202351 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.202762 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.202762 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.203062 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.203215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.203443 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.203585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.203585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.203868 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.204014 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.204014 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.204273 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.204424 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.204424 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.204807 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.204972 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.205112 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.205250 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.205250 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.205250 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.205669 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.205808 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.205957 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.206107 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.206107 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.206453 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.206593 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.206593 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.206885 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.207023 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.207182 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.207331 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.207331 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.207331 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.207331 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.207855 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.207993 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.208143 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.208281 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.208417 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.208576 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.208797 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.208930 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.208930 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.209225 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.209376 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.209376 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.209376 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.209778 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.209778 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.210064 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.210214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.210359 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.210359 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.210658 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.210797 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.210942 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.211091 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.211091 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.211410 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.211750 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.211927 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.212075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.212075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.212356 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.212494 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.212494 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.213014 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.213161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.213161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.213451 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.213770 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.213770 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.214048 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.214187 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.214326 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.214476 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.214624 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.215189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.215189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.215189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.215584 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.215734 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.215891 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.216036 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.216036 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.216306 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.216452 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.216452 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.216761 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.216901 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.216901 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.217200 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.217345 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.217493 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.217632 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.217632 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.217902 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.218039 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.218189 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.218338 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.218338 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.218610 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.218759 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.218919 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.219082 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.219082 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.219372 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.219516 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.219666 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.219844 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.219992 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.220146 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.220146 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.220146 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.220555 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.220718 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.220718 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.221100 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.221245 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.221245 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.221563 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.221815 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.221815 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.222201 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.222345 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.222345 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.222635 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.222782 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.222782 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.223338 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.223499 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.223499 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.223900 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.224058 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.224219 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.224365 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.224509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.224689 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.224842 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.225011 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.225164 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.225321 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.225465 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.225609 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.225753 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.225906 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.226060 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.226213 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.226364 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.226518 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.226670 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.226829 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.226982 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.227127 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.228055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.228055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.228353 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.228508 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.228730 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.228895 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.228895 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.229178 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.229178 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.229463 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.229609 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.229760 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.229905 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.230072 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.230233 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.230385 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.230537 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.230681 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.230832 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.230984 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.231138 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.231282 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.231425 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.231620 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.231797 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.231797 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.232199 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.232346 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.232497 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.232649 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.232836 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.232987 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.233146 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.233523 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.233675 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.233820 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.233820 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.234211 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.234376 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.234529 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.234682 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.234834 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.234979 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.235137 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.235290 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.235290 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.235570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.235722 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.235874 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.236029 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.236175 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.236329 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.236481 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.236633 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.236870 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.237680 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.238459 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.238632 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.238786 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.239188 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.239356 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.239510 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.239675 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.239675 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.239970 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.240124 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.240277 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.240438 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.240594 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.240822 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.240982 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.240982 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.241259 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.241404 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.241557 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.241760 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.241760 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.242064 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.242306 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.242457 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.242613 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.242613 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.242914 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.243061 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.243204 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.243347 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.243745 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.243910 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.244084 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.244328 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.244479 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.244640 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.244824 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.244978 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.245123 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.245275 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.245275 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.245275 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.245700 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.245852 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.246015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.246161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.246314 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.246472 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.246620 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.246764 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.246950 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.247109 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.247255 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.247407 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.247552 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.247552 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.247830 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.247999 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.248162 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.248307 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.248459 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.248612 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.248810 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.248810 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.249103 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.249281 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.249436 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.249588 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.249749 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.249905 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.250068 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.250214 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.250358 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.250744 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.250917 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.251064 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.251217 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.251363 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.251507 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.251659 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.252606 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.252762 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.252859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.252859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.253033 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.253188 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.253331 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.253331 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.253586 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.253947 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.254091 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.254221 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.254466 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.254600 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.254729 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.254857 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.254857 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.255115 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.255245 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.255373 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.255501 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.255501 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.255750 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.255894 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.256024 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.256162 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.256291 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.256419 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.256555 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.256740 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.256885 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.257020 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.257148 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.257284 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.257420 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.257564 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.257693 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.257821 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.257948 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.258075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.258226 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.258355 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.258491 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.258628 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.258764 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.258892 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.258892 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.259151 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.259288 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.259416 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.259544 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.259670 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.259807 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.259936 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.260064 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.260191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.260326 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.260455 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.260596 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.260744 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.260885 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.261014 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.261141 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.261278 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.261425 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.261554 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.261682 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.261817 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.261996 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.262140 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.262270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.262406 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.262535 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.262750 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.262886 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.263028 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.263166 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.263302 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.263433 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.263571 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.263751 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.263894 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.264200 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.264330 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.264472 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.264472 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.264905 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.265039 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.265168 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.265296 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.265423 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.265560 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.265700 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.265838 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.265967 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.266096 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.266223 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.266351 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.266488 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.266628 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.266758 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.266885 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.267012 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.267154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.267301 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.267440 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.267576 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.267714 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.267843 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.267981 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.268110 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.268237 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.268373 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.268503 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.268630 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.268815 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.268947 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.269075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.269214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.269351 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.269479 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.269618 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.269747 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.269883 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.270012 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.270139 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.270277 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.270413 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.270541 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.270669 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.270796 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.270932 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.271076 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.271206 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.271335 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.271462 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.271462 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.271722 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.271869 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.272042 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.272184 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.272320 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.272458 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.272587 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.272833 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.272983 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.273114 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.273250 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.273386 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.273524 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.273661 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.273661 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.273954 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.273954 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.274412 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.274560 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.274704 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.274895 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.275013 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.275123 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.275233 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.275354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.275467 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.275584 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.275704 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.275821 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.275942 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.276055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.276164 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.276283 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.276401 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.276512 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.276636 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.276795 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.276922 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.276922 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.277138 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.277261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.277391 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.277391 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.277599 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.277715 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.277834 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.277956 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.278079 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.278191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.278301 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.278410 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.278519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.278711 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.278825 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.279031 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.279217 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.279348 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.279472 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.279584 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.279695 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.279812 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.279923 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.280040 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.280161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.280273 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.280391 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.280509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.280643 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.280643 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.280938 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.281070 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.281206 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.281365 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.281494 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.281631 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.281760 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.281895 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.282075 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.282206 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.282206 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.282479 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.282609 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.282737 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.282867 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.282996 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.283117 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.283236 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.283356 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.283475 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.283585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.283693 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.283818 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.283937 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.284047 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.284155 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.284265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.284763 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.285006 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.285234 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.285376 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.285514 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.285644 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.285773 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.285911 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.286040 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.286168 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.286297 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.286425 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.286561 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.286700 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.286830 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.286959 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.287095 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.287240 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.287379 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.287510 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.287510 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.287759 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.287897 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.288039 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.288183 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.288319 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.288448 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.288577 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.288758 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.288888 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.289021 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.289152 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.289280 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.289408 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.289544 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.289674 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.289863 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.290004 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.290198 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.290339 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.290518 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.290660 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.290841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.290979 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.291145 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.291283 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.291453 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.291595 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.291764 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.291905 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.292075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.292256 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.292393 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.292530 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.292688 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.292971 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.293122 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.293251 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.293386 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.293525 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.293654 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.293789 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.293928 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.294066 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.294204 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.294343 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.294507 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.294817 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.294952 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.295079 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.295237 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.295438 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.295568 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.295695 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.295821 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.295949 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.296092 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.296228 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.296378 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.296508 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.296710 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.296843 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.297025 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.297175 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.297414 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.297593 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.297732 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.297872 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.298003 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.298130 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.298266 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.298410 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.298646 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.298790 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.298957 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.299083 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.299261 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.299399 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.299587 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.299730 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.299903 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.300059 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.300242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.300768 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.300993 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.301144 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.301265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.301398 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.301534 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.301661 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.301849 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.301981 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.302164 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.302497 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.302637 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.302811 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.302955 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.303152 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.303283 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.303491 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.303624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.303826 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.303968 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.304141 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.304437 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.304578 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.304756 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.305082 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.305227 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.305360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.305564 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.305706 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.305836 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.305976 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.306116 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.306247 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.306384 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.306514 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.306642 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.306779 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.306917 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.307047 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.307176 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.307313 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.307479 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.307625 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.307793 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.307933 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.308104 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.308235 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.308419 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.308563 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.308757 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.308914 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.309137 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.309280 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.309423 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.309555 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.309690 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.309827 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.309992 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.310182 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.310326 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.310577 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.310700 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.310889 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.311131 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.311282 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.311403 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.311530 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.311660 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.311838 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.311997 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.312164 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.312287 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.312484 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.312794 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.312897 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.313113 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.313222 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.313431 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.313523 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.313745 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.313840 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.314059 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.314237 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.314372 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.314466 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.314689 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.314789 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.315025 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.315117 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.315343 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.315445 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.315710 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.315808 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.316085 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.316223 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.316413 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.316516 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.316763 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.316873 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.317082 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.317177 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.317406 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.317501 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.317718 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.317829 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.318052 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.318147 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.318396 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.318498 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.318716 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.318818 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.319030 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.319135 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.319334 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.319427 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.319643 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.319748 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.319948 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.320044 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.320258 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.320361 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.320578 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.320735 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.320921 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.321022 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.321232 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.321420 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.321587 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.321736 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.321883 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.322028 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.322185 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.322370 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.322537 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.322692 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.322838 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.322991 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.323144 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.323290 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.323450 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.323603 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.323748 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.323901 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.324054 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.324225 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.324378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.324531 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.324710 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.324874 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.325021 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.325197 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.325516 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.325662 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.325807 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.326032 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.326181 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.326338 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.326503 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.326655 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.326803 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.326947 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.327099 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.327258 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.327406 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.327559 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.327712 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.327864 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.328022 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.328174 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.328328 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.328487 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.328632 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.328839 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.329006 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.329161 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.329306 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.329486 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.329632 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.329783 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.329937 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.330091 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.330237 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.330408 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.330556 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.330714 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.330878 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.331093 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.331290 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.331443 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.331590 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.331744 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.331898 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.332051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.332196 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.332348 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.332541 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.332756 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.332917 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.333063 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.333208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.333353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.333505 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.333661 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.333807 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.333959 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.334112 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.334257 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.334412 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.334567 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.334720 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.334873 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.335019 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.335164 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.335318 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.335644 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.335805 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.335952 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.336185 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.336336 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.336491 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.336647 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.336828 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.336974 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.337120 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.337273 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.337440 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.337596 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.337742 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.337895 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.338041 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.338201 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.338354 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.338511 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.338656 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.338799 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.338944 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.339098 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.339243 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.339388 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.339550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.339900 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.340064 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.340219 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.340373 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.340518 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.340698 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.340851 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.341010 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.341234 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.341394 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.341554 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.341709 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.341862 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.342017 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.342017 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.342302 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.342450 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.342643 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.342791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.342950 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.343096 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.343241 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.343391 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.343535 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.343535 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 21:13:04.344000 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.344000 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.344000 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:13:04.344000 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 21:13:04.404470 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO dbcounter [None req-382f57ed-a7b9-42a6-9dcf-602092371393 None None] Registered counter for database nova_api Sep 06 21:13:04.404784 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO dbcounter [None req-2c688453-336d-482b-a54f-6f27ca07ae4d None None] Registered counter for database nova_api Sep 06 21:13:04.426692 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_db.sqlalchemy.engines [None req-2c688453-336d-482b-a54f-6f27ca07ae4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120719) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 21:13:04.429095 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_db.sqlalchemy.engines [None req-382f57ed-a7b9-42a6-9dcf-602092371393 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 21:13:04.435820 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writer thread running {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 21:13:04.435990 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writer thread running {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 21:13:04.492683 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.context [None req-2c688453-336d-482b-a54f-6f27ca07ae4d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3890bd42-8750-4042-bca7-2b0af0e72591(cell1) {{(pid=120719) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 21:13:04.493991 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.context [None req-382f57ed-a7b9-42a6-9dcf-602092371393 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3890bd42-8750-4042-bca7-2b0af0e72591(cell1) {{(pid=120720) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 21:13:04.496785 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c688453-336d-482b-a54f-6f27ca07ae4d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:13:04.497255 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c688453-336d-482b-a54f-6f27ca07ae4d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:13:04.498072 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-382f57ed-a7b9-42a6-9dcf-602092371393 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:13:04.499086 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-382f57ed-a7b9-42a6-9dcf-602092371393 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:13:04.499232 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c688453-336d-482b-a54f-6f27ca07ae4d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:13:04.499584 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c688453-336d-482b-a54f-6f27ca07ae4d None None] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:13:04.500023 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c688453-336d-482b-a54f-6f27ca07ae4d None None] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:13:04.500167 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-382f57ed-a7b9-42a6-9dcf-602092371393 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:13:04.500868 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-382f57ed-a7b9-42a6-9dcf-602092371393 None None] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:13:04.501302 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-382f57ed-a7b9-42a6-9dcf-602092371393 None None] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:13:04.502092 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c688453-336d-482b-a54f-6f27ca07ae4d None None] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:13:04.503311 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-382f57ed-a7b9-42a6-9dcf-602092371393 None None] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:13:04.504187 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO dbcounter [None req-2c688453-336d-482b-a54f-6f27ca07ae4d None None] Registered counter for database nova_cell0 Sep 06 21:13:04.505378 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO dbcounter [None req-382f57ed-a7b9-42a6-9dcf-602092371393 None None] Registered counter for database nova_cell0 Sep 06 21:13:04.508598 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO dbcounter [None req-2c688453-336d-482b-a54f-6f27ca07ae4d None None] Registered counter for database nova_cell1 Sep 06 21:13:04.509634 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO dbcounter [None req-382f57ed-a7b9-42a6-9dcf-602092371393 None None] Registered counter for database nova_cell1 Sep 06 21:13:04.517045 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_db.sqlalchemy.engines [None req-2c688453-336d-482b-a54f-6f27ca07ae4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120719) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 21:13:04.518769 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_db.sqlalchemy.engines [None req-2c688453-336d-482b-a54f-6f27ca07ae4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120719) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 21:13:04.521407 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_db.sqlalchemy.engines [None req-382f57ed-a7b9-42a6-9dcf-602092371393 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 21:13:04.524232 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writer thread running {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 21:13:04.526663 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_db.sqlalchemy.engines [None req-382f57ed-a7b9-42a6-9dcf-602092371393 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 21:13:04.527549 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writer thread running {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 21:13:04.527669 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writer thread running {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 21:13:04.669495 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writer thread running {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 21:13:04.672285 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO dbcounter [None req-2c688453-336d-482b-a54f-6f27ca07ae4d None None] Registered counter for database nova_cell0 Sep 06 21:13:04.679895 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO dbcounter [None req-382f57ed-a7b9-42a6-9dcf-602092371393 None None] Registered counter for database nova_cell0 Sep 06 21:13:04.680153 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_db.sqlalchemy.engines [None req-2c688453-336d-482b-a54f-6f27ca07ae4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120719) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 21:13:04.685170 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writer thread running {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 21:13:04.688535 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_db.sqlalchemy.engines [None req-382f57ed-a7b9-42a6-9dcf-602092371393 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 21:13:04.693118 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writer thread running {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 21:13:05.014329 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: WARNING keystonemiddleware.auth_token [None req-2c688453-336d-482b-a54f-6f27ca07ae4d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 21:13:05.017949 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: WARNING keystonemiddleware.auth_token [None req-382f57ed-a7b9-42a6-9dcf-602092371393 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 21:13:05.021602 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: WARNING keystonemiddleware.auth_token [None req-2c688453-336d-482b-a54f-6f27ca07ae4d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 21:13:05.025290 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: WARNING keystonemiddleware.auth_token [None req-382f57ed-a7b9-42a6-9dcf-602092371393 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 21:13:05.371391 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: WARNING keystonemiddleware.auth_token [None req-2c688453-336d-482b-a54f-6f27ca07ae4d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 21:13:05.372247 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: WARNING keystonemiddleware.auth_token [None req-382f57ed-a7b9-42a6-9dcf-602092371393 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 21:13:05.377448 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: WARNING keystonemiddleware.auth_token [None req-2c688453-336d-482b-a54f-6f27ca07ae4d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 21:13:05.378577 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: WARNING keystonemiddleware.auth_token [None req-382f57ed-a7b9-42a6-9dcf-602092371393 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 21:13:05.383124 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b43f2709c0 pid: 120719 (default app) Sep 06 21:13:05.383931 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b43f2709c0 pid: 120720 (default app) Sep 06 21:13:40.369780 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:13:40.370950 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:13:40.371879 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:13:40.373029 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:13:41.593352 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6e07dc1f-7d34-4cb3-96d7-c2f515bd7f43 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Action: 'create', calling method: .version_select at 0x7f04cf57f3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-36965455"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:13:41.935061 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:13:41.936521 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:13:41.938405 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:13:41.939429 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:13:43.423798 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a376af49-c503-449a-9264-6a5e1d0cf026 tempest-VolumesGetTestJSON-1404738214 tempest-VolumesGetTestJSON-1404738214-project] Action: 'create', calling method: .version_select at 0x7f04cf57f430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-70843224", "metadata": {"Type": "work"}}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:13:43.897312 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6e07dc1f-7d34-4cb3-96d7-c2f515bd7f43 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 3.539347 Sep 06 21:13:43.898850 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1/1] 10.222.0.79 () {60 vars in 1155 bytes} [Tue Sep 6 21:13:40 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 3543 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 06 21:13:43.918857 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9e31b933-c50e-481d-81fa-35b23f4687eb tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Calling method '.version_select at 0x7f04cf461280>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:44.231489 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9e31b933-c50e-481d-81fa-35b23f4687eb tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/7bfca415-6bfd-4088-b257-90fcc19297f4" status: 200 len: 343 microversion: 2.1 time: 0.318656 Sep 06 21:13:44.239824 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2/2] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Sep 6 21:13:43 2022] GET /compute/v2.1/os-volumes/7bfca415-6bfd-4088-b257-90fcc19297f4 => generated 343 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:13:44.616477 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a376af49-c503-449a-9264-6a5e1d0cf026 tempest-VolumesGetTestJSON-1404738214 tempest-VolumesGetTestJSON-1404738214-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 2.695508 Sep 06 21:13:44.625771 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1/3] 10.222.0.79 () {60 vars in 1156 bytes} [Tue Sep 6 21:13:41 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 2706 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 06 21:13:44.632449 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fbf32e7c-dba4-4c2b-b928-62675159e8c4 tempest-VolumesGetTestJSON-1404738214 tempest-VolumesGetTestJSON-1404738214-project] Calling method '.version_select at 0x7f04cf461940>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:44.733670 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fbf32e7c-dba4-4c2b-b928-62675159e8c4 tempest-VolumesGetTestJSON-1404738214 tempest-VolumesGetTestJSON-1404738214-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/8667673c-66c3-4b16-9769-79fa5f7782c5" status: 200 len: 351 microversion: 2.1 time: 0.103440 Sep 06 21:13:44.735920 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3/4] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Sep 6 21:13:44 2022] GET /compute/v2.1/os-volumes/8667673c-66c3-4b16-9769-79fa5f7782c5 => generated 351 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:13:45.248069 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-db7e4209-4ef8-4e66-8df7-1ff59a7b3ea1 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Calling method '.version_select at 0x7f04cf452310>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:45.403110 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-db7e4209-4ef8-4e66-8df7-1ff59a7b3ea1 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/7bfca415-6bfd-4088-b257-90fcc19297f4" status: 200 len: 344 microversion: 2.1 time: 0.140280 Sep 06 21:13:45.403110 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2/5] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Sep 6 21:13:45 2022] GET /compute/v2.1/os-volumes/7bfca415-6bfd-4088-b257-90fcc19297f4 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:13:45.408686 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f2b22455-cc85-4ed5-aaff-de098086a0d9 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Action: 'create', calling method: .version_select at 0x7f04cf3ea040>, body: {"snapshot": {"volume_id": "7bfca415-6bfd-4088-b257-90fcc19297f4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1711322984"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:13:45.752336 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bdaa19bd-3af5-49ac-9b33-c09fb3f185d1 tempest-VolumesGetTestJSON-1404738214 tempest-VolumesGetTestJSON-1404738214-project] Calling method '.version_select at 0x7f04cf452a60>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:45.873886 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f2b22455-cc85-4ed5-aaff-de098086a0d9 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] 10.222.0.79 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.474836 Sep 06 21:13:45.874469 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 4/6] 10.222.0.79 () {60 vars in 1162 bytes} [Tue Sep 6 21:13:45 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:13:45.897975 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-84b1a166-162a-4000-89bc-f4c8d17a2793 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Calling method '.version_select at 0x7f04cf3ea8b0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:45.966319 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bdaa19bd-3af5-49ac-9b33-c09fb3f185d1 tempest-VolumesGetTestJSON-1404738214 tempest-VolumesGetTestJSON-1404738214-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/8667673c-66c3-4b16-9769-79fa5f7782c5" status: 200 len: 352 microversion: 2.1 time: 0.219796 Sep 06 21:13:45.967257 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3/7] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Sep 6 21:13:45 2022] GET /compute/v2.1/os-volumes/8667673c-66c3-4b16-9769-79fa5f7782c5 => generated 352 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:13:45.980465 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d23f25d5-25e9-4d57-85d0-9baefcef851b tempest-VolumesGetTestJSON-1404738214 tempest-VolumesGetTestJSON-1404738214-project] Calling method '.version_select at 0x7f04cf462160>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:46.012146 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-84b1a166-162a-4000-89bc-f4c8d17a2793 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/c465f894-81b7-4101-9a9c-32a43db67cb1" status: 200 len: 287 microversion: 2.1 time: 0.128113 Sep 06 21:13:46.013319 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 5/8] 10.222.0.79 () {58 vars in 1251 bytes} [Tue Sep 6 21:13:45 2022] GET /compute/v2.1/os-snapshots/c465f894-81b7-4101-9a9c-32a43db67cb1 => generated 287 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 21:13:46.025974 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c09c533b-a91c-48a5-88f1-09094188501a tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Calling method '.version_select at 0x7f04cf3ea1f0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:46.123618 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d23f25d5-25e9-4d57-85d0-9baefcef851b tempest-VolumesGetTestJSON-1404738214 tempest-VolumesGetTestJSON-1404738214-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/8667673c-66c3-4b16-9769-79fa5f7782c5" status: 200 len: 352 microversion: 2.1 time: 0.146711 Sep 06 21:13:46.124974 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4/9] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Sep 6 21:13:45 2022] GET /compute/v2.1/os-volumes/8667673c-66c3-4b16-9769-79fa5f7782c5 => generated 352 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:13:46.150410 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cdba1b4a-4b01-4026-a64a-a432353179f5 tempest-VolumesGetTestJSON-1404738214 tempest-VolumesGetTestJSON-1404738214-project] Calling method '.version_select at 0x7f04cf452d30>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:46.232551 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c09c533b-a91c-48a5-88f1-09094188501a tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.211031 Sep 06 21:13:46.233440 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 6/10] 10.222.0.79 () {58 vars in 1140 bytes} [Tue Sep 6 21:13:46 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:13:46.245963 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ae0a0ecb-4061-48f4-aa61-ada11332fe77 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Calling method '.version_select at 0x7f04cf3e8d30>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:46.515035 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cdba1b4a-4b01-4026-a64a-a432353179f5 tempest-VolumesGetTestJSON-1404738214 tempest-VolumesGetTestJSON-1404738214-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/8667673c-66c3-4b16-9769-79fa5f7782c5" status: 202 len: 0 microversion: 2.1 time: 0.370499 Sep 06 21:13:46.515601 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 5/11] 10.222.0.79 () {58 vars in 1248 bytes} [Tue Sep 6 21:13:46 2022] DELETE /compute/v2.1/os-volumes/8667673c-66c3-4b16-9769-79fa5f7782c5 => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:13:46.523804 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-53dc02aa-c63b-44a6-b292-debe6a41dbb8 tempest-VolumesGetTestJSON-1404738214 tempest-VolumesGetTestJSON-1404738214-project] Calling method '.version_select at 0x7f04cf4525e0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:46.546404 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ae0a0ecb-4061-48f4-aa61-ada11332fe77 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/c465f894-81b7-4101-9a9c-32a43db67cb1" status: 200 len: 287 microversion: 2.1 time: 0.304904 Sep 06 21:13:46.549160 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 7/12] 10.222.0.79 () {58 vars in 1251 bytes} [Tue Sep 6 21:13:46 2022] GET /compute/v2.1/os-snapshots/c465f894-81b7-4101-9a9c-32a43db67cb1 => generated 287 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:13:46.646523 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-53dc02aa-c63b-44a6-b292-debe6a41dbb8 tempest-VolumesGetTestJSON-1404738214 tempest-VolumesGetTestJSON-1404738214-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/8667673c-66c3-4b16-9769-79fa5f7782c5" status: 200 len: 351 microversion: 2.1 time: 0.126634 Sep 06 21:13:46.653498 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 6/13] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Sep 6 21:13:46 2022] GET /compute/v2.1/os-volumes/8667673c-66c3-4b16-9769-79fa5f7782c5 => generated 351 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 21:13:47.562242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ebbb9df6-3eb2-48e7-a809-49d3aacb011a tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Calling method '.version_select at 0x7f04cf3e8700>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:47.661619 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cececad3-f7e3-4e37-a2b6-0526859224a2 tempest-VolumesGetTestJSON-1404738214 tempest-VolumesGetTestJSON-1404738214-project] Calling method '.version_select at 0x7f04cf462280>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:47.681872 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ebbb9df6-3eb2-48e7-a809-49d3aacb011a tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/c465f894-81b7-4101-9a9c-32a43db67cb1" status: 200 len: 287 microversion: 2.1 time: 0.124048 Sep 06 21:13:47.682423 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 8/14] 10.222.0.79 () {58 vars in 1251 bytes} [Tue Sep 6 21:13:47 2022] GET /compute/v2.1/os-snapshots/c465f894-81b7-4101-9a9c-32a43db67cb1 => generated 287 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:13:47.771034 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cececad3-f7e3-4e37-a2b6-0526859224a2 tempest-VolumesGetTestJSON-1404738214 tempest-VolumesGetTestJSON-1404738214-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/8667673c-66c3-4b16-9769-79fa5f7782c5" status: 200 len: 351 microversion: 2.1 time: 0.113534 Sep 06 21:13:47.772114 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 7/15] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Sep 6 21:13:47 2022] GET /compute/v2.1/os-volumes/8667673c-66c3-4b16-9769-79fa5f7782c5 => generated 351 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:13:48.697937 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-15f0df37-10d5-456b-abbc-73b415274e3f tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Calling method '.version_select at 0x7f04cf3e80d0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:48.733780 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-15f0df37-10d5-456b-abbc-73b415274e3f tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/c465f894-81b7-4101-9a9c-32a43db67cb1" status: 200 len: 287 microversion: 2.1 time: 0.042288 Sep 06 21:13:48.735817 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 9/16] 10.222.0.79 () {58 vars in 1251 bytes} [Tue Sep 6 21:13:48 2022] GET /compute/v2.1/os-snapshots/c465f894-81b7-4101-9a9c-32a43db67cb1 => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:13:48.786019 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d97cd968-62c9-4e41-afad-6705f325f84d tempest-VolumesGetTestJSON-1404738214 tempest-VolumesGetTestJSON-1404738214-project] Calling method '.version_select at 0x7f04cf4523a0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:48.927349 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d97cd968-62c9-4e41-afad-6705f325f84d tempest-VolumesGetTestJSON-1404738214 tempest-VolumesGetTestJSON-1404738214-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/8667673c-66c3-4b16-9769-79fa5f7782c5" status: 200 len: 351 microversion: 2.1 time: 0.139166 Sep 06 21:13:48.929763 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 8/17] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Sep 6 21:13:48 2022] GET /compute/v2.1/os-volumes/8667673c-66c3-4b16-9769-79fa5f7782c5 => generated 351 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:13:49.747362 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-092732bf-5435-474b-8cc8-cc64e9dd701c tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Calling method '.version_select at 0x7f04cf3ea0d0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:49.821343 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-092732bf-5435-474b-8cc8-cc64e9dd701c tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/c465f894-81b7-4101-9a9c-32a43db67cb1" status: 200 len: 287 microversion: 2.1 time: 0.077538 Sep 06 21:13:49.822677 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 10/18] 10.222.0.79 () {58 vars in 1251 bytes} [Tue Sep 6 21:13:49 2022] GET /compute/v2.1/os-snapshots/c465f894-81b7-4101-9a9c-32a43db67cb1 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:13:49.941066 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c8e3b531-5a17-4142-9f77-b7d899c9e587 tempest-VolumesGetTestJSON-1404738214 tempest-VolumesGetTestJSON-1404738214-project] Calling method '.version_select at 0x7f04cf452af0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:50.078260 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c8e3b531-5a17-4142-9f77-b7d899c9e587 tempest-VolumesGetTestJSON-1404738214 tempest-VolumesGetTestJSON-1404738214-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/8667673c-66c3-4b16-9769-79fa5f7782c5" status: 200 len: 351 microversion: 2.1 time: 0.140702 Sep 06 21:13:50.084758 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 9/19] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Sep 6 21:13:49 2022] GET /compute/v2.1/os-volumes/8667673c-66c3-4b16-9769-79fa5f7782c5 => generated 351 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:13:50.836194 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-50205403-59ee-42ed-89a5-d579060e2567 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Calling method '.version_select at 0x7f04cf3ea790>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:50.882115 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-50205403-59ee-42ed-89a5-d579060e2567 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/c465f894-81b7-4101-9a9c-32a43db67cb1" status: 200 len: 287 microversion: 2.1 time: 0.050166 Sep 06 21:13:50.883936 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 11/20] 10.222.0.79 () {58 vars in 1251 bytes} [Tue Sep 6 21:13:50 2022] GET /compute/v2.1/os-snapshots/c465f894-81b7-4101-9a9c-32a43db67cb1 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:13:51.094330 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3c75b5ac-5cc1-4bac-8dda-912f50d4a938 tempest-VolumesGetTestJSON-1404738214 tempest-VolumesGetTestJSON-1404738214-project] Calling method '.version_select at 0x7f04cf4625e0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:51.247011 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3c75b5ac-5cc1-4bac-8dda-912f50d4a938 tempest-VolumesGetTestJSON-1404738214 tempest-VolumesGetTestJSON-1404738214-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/8667673c-66c3-4b16-9769-79fa5f7782c5" status: 200 len: 351 microversion: 2.1 time: 0.156515 Sep 06 21:13:51.247570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 10/21] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Sep 6 21:13:51 2022] GET /compute/v2.1/os-volumes/8667673c-66c3-4b16-9769-79fa5f7782c5 => generated 351 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:13:51.899570 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f1d43eee-8506-46d0-b278-9eaff83fe0c3 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Calling method '.version_select at 0x7f04cf3e8c10>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:51.944996 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f1d43eee-8506-46d0-b278-9eaff83fe0c3 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/c465f894-81b7-4101-9a9c-32a43db67cb1" status: 200 len: 287 microversion: 2.1 time: 0.051985 Sep 06 21:13:51.946077 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 12/22] 10.222.0.79 () {58 vars in 1251 bytes} [Tue Sep 6 21:13:51 2022] GET /compute/v2.1/os-snapshots/c465f894-81b7-4101-9a9c-32a43db67cb1 => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:13:52.261641 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-505e9fd1-374d-4c8f-ad91-054bdd794be5 tempest-VolumesGetTestJSON-1404738214 tempest-VolumesGetTestJSON-1404738214-project] Calling method '.version_select at 0x7f04cf462820>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:52.355429 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-505e9fd1-374d-4c8f-ad91-054bdd794be5 tempest-VolumesGetTestJSON-1404738214 tempest-VolumesGetTestJSON-1404738214-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/8667673c-66c3-4b16-9769-79fa5f7782c5" status: 200 len: 351 microversion: 2.1 time: 0.097556 Sep 06 21:13:52.357804 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 11/23] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Sep 6 21:13:52 2022] GET /compute/v2.1/os-volumes/8667673c-66c3-4b16-9769-79fa5f7782c5 => generated 351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:13:52.958311 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-795c3745-5f70-415c-9259-d820e41177e6 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Calling method '.version_select at 0x7f04cf3e8280>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:53.016558 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-795c3745-5f70-415c-9259-d820e41177e6 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/c465f894-81b7-4101-9a9c-32a43db67cb1" status: 200 len: 288 microversion: 2.1 time: 0.062073 Sep 06 21:13:53.017368 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 13/24] 10.222.0.79 () {58 vars in 1251 bytes} [Tue Sep 6 21:13:52 2022] GET /compute/v2.1/os-snapshots/c465f894-81b7-4101-9a9c-32a43db67cb1 => generated 288 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:13:53.029589 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d839e962-b0a6-47ab-8433-a84ce2df801b tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Calling method '.version_select at 0x7f04cf452e50>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:53.250901 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d839e962-b0a6-47ab-8433-a84ce2df801b tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] 10.222.0.79 "DELETE /compute/v2.1/os-snapshots/c465f894-81b7-4101-9a9c-32a43db67cb1" status: 202 len: 0 microversion: 2.1 time: 0.225063 Sep 06 21:13:53.251637 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 12/25] 10.222.0.79 () {58 vars in 1254 bytes} [Tue Sep 6 21:13:53 2022] DELETE /compute/v2.1/os-snapshots/c465f894-81b7-4101-9a9c-32a43db67cb1 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:13:53.260202 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b1c2b6e2-fb15-462c-912e-e543f24fad6a tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Calling method '.version_select at 0x7f04cf3ea8b0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:53.314902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b1c2b6e2-fb15-462c-912e-e543f24fad6a tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/c465f894-81b7-4101-9a9c-32a43db67cb1" status: 200 len: 287 microversion: 2.1 time: 0.058681 Sep 06 21:13:53.316207 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 14/26] 10.222.0.79 () {58 vars in 1251 bytes} [Tue Sep 6 21:13:53 2022] GET /compute/v2.1/os-snapshots/c465f894-81b7-4101-9a9c-32a43db67cb1 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:13:53.384073 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6f6cc477-804f-4eff-be8a-ff3ee1b8d4e3 tempest-VolumesGetTestJSON-1404738214 tempest-VolumesGetTestJSON-1404738214-project] Calling method '.version_select at 0x7f04cf4528b0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:53.532920 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6f6cc477-804f-4eff-be8a-ff3ee1b8d4e3 tempest-VolumesGetTestJSON-1404738214 tempest-VolumesGetTestJSON-1404738214-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/8667673c-66c3-4b16-9769-79fa5f7782c5" status: 200 len: 351 microversion: 2.1 time: 0.162213 Sep 06 21:13:53.541366 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 13/27] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Sep 6 21:13:53 2022] GET /compute/v2.1/os-volumes/8667673c-66c3-4b16-9769-79fa5f7782c5 => generated 351 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:13:53.810745 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b02337e8-51f4-4fa9-96fc-c1a18b93ef82 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Action: 'create', calling method: .version_select at 0x7f04cf3ea1f0>, body: {"keypair": {"name": "tempest-keypair-1797284754", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPf2Sl4gUCI5cG3S7QkB9x9oryVtUYknUHG4ebRdMVzINsVKNjVwRqdE+7RPcWoqGYQsYU3pEj/18m4vrpL8msiRc8+7iXEAFZjOBABm0iTzHlLIBkj9BYT+BNBya2V3AA=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:13:53.945655 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-b02337e8-51f4-4fa9-96fc-c1a18b93ef82 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Getting quotas for project 2e39683d687e424fbed4539cb4040060. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:13:53.969057 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-b02337e8-51f4-4fa9-96fc-c1a18b93ef82 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Getting quotas for user 54fe3d99f05c45f099804fccb4679503 and project 2e39683d687e424fbed4539cb4040060. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:13:54.095291 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b02337e8-51f4-4fa9-96fc-c1a18b93ef82 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.654392 Sep 06 21:13:54.096176 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 15/28] 10.222.0.79 () {62 vars in 1200 bytes} [Tue Sep 6 21:13:53 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 656 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 06 21:13:54.328690 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-95afdf7d-a9cd-40f5-ba36-096e74b35cf8 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Calling method '.version_select at 0x7f04cf462af0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:54.383473 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-95afdf7d-a9cd-40f5-ba36-096e74b35cf8 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] HTTP exception thrown: Snapshot c465f894-81b7-4101-9a9c-32a43db67cb1 could not be found. Sep 06 21:13:54.387671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-95afdf7d-a9cd-40f5-ba36-096e74b35cf8 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Request method failure captured: Sep 06 21:13:54.387671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/os-snapshots/c465f894-81b7-4101-9a9c-32a43db67cb1 HTTP/1.1 Sep 06 21:13:54.387671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 06 21:13:54.387671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 06 21:13:54.387671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Connection: close Sep 06 21:13:54.387671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 06 21:13:54.387671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 06 21:13:54.387671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Host: 10.222.0.79 Sep 06 21:13:54.387671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 06 21:13:54.387671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 06 21:13:54.387671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjF7gEi1Sqp2mclISXqF8t4-HP1GpYhbqJX3xPnALyZYXlDwoN9RpTCs1WIOAlu4mdYeoZktIngpjUciqOtgkWm0l2ZwbIz4ziOIfWNM00Ug-94O7UL0JuVKSXg_wBXt2tmuqWan_SCS3oWuAZZJrxG5GIjjUBQMlXDodLscJ3Q9KfYLg Sep 06 21:13:54.387671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 06 21:13:54.387671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 06 21:13:54.387671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 06 21:13:54.387671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 06 21:13:54.387671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 06 21:13:54.387671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 06 21:13:54.387671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Id: 8ba0f5f714694c249c785253abd18dc8 Sep 06 21:13:54.387671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1973155764 Sep 06 21:13:54.387671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Role: reader,member Sep 06 21:13:54.387671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Sep 06 21:13:54.389773 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8ba0f5f714694c249c785253abd18dc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8ba0f5f714694c249c785253abd18dc8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8ba0f5f714694c249c785253abd18dc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8ba0f5f714694c249c785253abd18dc8"}]}] Sep 06 21:13:54.389773 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1973155764 Sep 06 21:13:54.389773 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 8ba0f5f714694c249c785253abd18dc8 Sep 06 21:13:54.389773 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1973155764 Sep 06 21:13:54.389773 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User: tempest-VolumesSnapshotsTestJSON-1973155764-project Sep 06 21:13:54.389773 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 06 21:13:54.389773 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 06 21:13:54.389773 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Id: 8bf3e32edd3a41daaecfe6c73a761363 Sep 06 21:13:54.389773 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1973155764-project Sep 06 21:13:54.389773 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: method: Sep 06 21:13:54.389773 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: exception: Snapshot c465f894-81b7-4101-9a9c-32a43db67cb1 could not be found. Sep 06 21:13:54.389773 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: action_args: {'id': 'c465f894-81b7-4101-9a9c-32a43db67cb1'} Sep 06 21:13:54.389773 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:13:54.390467 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:13:54.390467 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 06 21:13:54.390467 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 06 21:13:54.390467 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 06 21:13:54.390467 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 06 21:13:54.390467 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 06 21:13:54.390467 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 06 21:13:54.390467 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 21:13:54.390467 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 21:13:54.390467 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 21:13:54.390467 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 21:13:54.390467 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 21:13:54.390467 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 21:13:54.390467 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 21:13:54.390467 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 21:13:54.390467 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c465f894-81b7-4101-9a9c-32a43db67cb1 could not be found. (HTTP 404) (Request-ID: req-72b14cf0-afd1-4597-811d-04c906148e50) Sep 06 21:13:54.390467 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:13:54.390467 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:13:54.391973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:13:54.391973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:13:54.391973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 06 21:13:54.391973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 06 21:13:54.391973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 21:13:54.391973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 21:13:54.391973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 06 21:13:54.391973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 06 21:13:54.391973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 21:13:54.391973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 21:13:54.391973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 06 21:13:54.391973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 06 21:13:54.391973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 06 21:13:54.391973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 06 21:13:54.391973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 06 21:13:54.391973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 06 21:13:54.391973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 21:13:54.391973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 21:13:54.391973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 21:13:54.394354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 21:13:54.394354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 21:13:54.394354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 21:13:54.394354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 21:13:54.394354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 21:13:54.394354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c465f894-81b7-4101-9a9c-32a43db67cb1 could not be found. Sep 06 21:13:54.394354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:13:54.394354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:13:54.394354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:13:54.394354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:13:54.394354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:13:54.394354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:13:54.394354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:13:54.394354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:13:54.394354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 21:13:54.394354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 21:13:54.394354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:13:54.394354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:13:54.394354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 06 21:13:54.394354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:13:54.396926 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c465f894-81b7-4101-9a9c-32a43db67cb1 could not be found. Sep 06 21:13:54.396926 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:13:54.396926 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:13:54.396926 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:13:54.396926 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:13:54.396926 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:13:54.396926 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:13:54.396926 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:13:54.396926 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:13:54.396926 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c465f894-81b7-4101-9a9c-32a43db67cb1 could not be found. Sep 06 21:13:54.396926 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:13:54.396926 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-95afdf7d-a9cd-40f5-ba36-096e74b35cf8 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Returning 404 to user: Snapshot c465f894-81b7-4101-9a9c-32a43db67cb1 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:13:54.396926 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-95afdf7d-a9cd-40f5-ba36-096e74b35cf8 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/c465f894-81b7-4101-9a9c-32a43db67cb1" status: 404 len: 111 microversion: 2.1 time: 0.064798 Sep 06 21:13:54.398476 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 14/29] 10.222.0.79 () {58 vars in 1251 bytes} [Tue Sep 6 21:13:54 2022] GET /compute/v2.1/os-snapshots/c465f894-81b7-4101-9a9c-32a43db67cb1 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:13:54.400697 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-21f093ce-913d-4092-a7d0-f6c7e7157477 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Calling method '.version_select at 0x7f04cf374430>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:54.552288 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-63f34b90-8a5a-42db-b0b9-3a5081095aa4 tempest-VolumesGetTestJSON-1404738214 tempest-VolumesGetTestJSON-1404738214-project] Calling method '.version_select at 0x7f04cf462c10>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:54.559110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-21f093ce-913d-4092-a7d0-f6c7e7157477 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/7bfca415-6bfd-4088-b257-90fcc19297f4" status: 202 len: 0 microversion: 2.1 time: 0.164380 Sep 06 21:13:54.560053 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 16/30] 10.222.0.79 () {58 vars in 1248 bytes} [Tue Sep 6 21:13:54 2022] DELETE /compute/v2.1/os-volumes/7bfca415-6bfd-4088-b257-90fcc19297f4 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:13:54.569241 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0c010baf-71ed-46ea-91ab-bdbf171a3153 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Calling method '.version_select at 0x7f04cf374af0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:54.622690 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-63f34b90-8a5a-42db-b0b9-3a5081095aa4 tempest-VolumesGetTestJSON-1404738214 tempest-VolumesGetTestJSON-1404738214-project] HTTP exception thrown: Volume 8667673c-66c3-4b16-9769-79fa5f7782c5 could not be found. Sep 06 21:13:54.625831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-63f34b90-8a5a-42db-b0b9-3a5081095aa4 tempest-VolumesGetTestJSON-1404738214 tempest-VolumesGetTestJSON-1404738214-project] Request method failure captured: Sep 06 21:13:54.625831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/os-volumes/8667673c-66c3-4b16-9769-79fa5f7782c5 HTTP/1.1 Sep 06 21:13:54.625831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 06 21:13:54.625831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 06 21:13:54.625831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Connection: close Sep 06 21:13:54.625831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 06 21:13:54.625831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 06 21:13:54.625831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Host: 10.222.0.79 Sep 06 21:13:54.625831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 06 21:13:54.625831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 06 21:13:54.625831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjF7gF1J_vw9-GZx4pRBcdWSjq31PU7wdRuwVwiqncI6yOqSDtqzkdo0wgkpnFA2BK9CZ_PTgx76UR-UGOLnSv7mZEYLiPY1jSAqL2iZKg2L56gYfC8k1fIY3NHAp_AM3DMqrK3j2M03eQ1xqjXyOCVar5-HbkKAjgQn2ppryQFpTOS34 Sep 06 21:13:54.625831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 06 21:13:54.625831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 06 21:13:54.625831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 06 21:13:54.625831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 06 21:13:54.625831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 06 21:13:54.625831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 06 21:13:54.625831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Id: 8e2d0b17f13b4989bbb230a60d6c5662 Sep 06 21:13:54.625831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesGetTestJSON-1404738214 Sep 06 21:13:54.625831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Role: reader,member Sep 06 21:13:54.625831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Sep 06 21:13:54.626946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8e2d0b17f13b4989bbb230a60d6c5662"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8e2d0b17f13b4989bbb230a60d6c5662", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8e2d0b17f13b4989bbb230a60d6c5662"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8e2d0b17f13b4989bbb230a60d6c5662"}]}] Sep 06 21:13:54.626946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-VolumesGetTestJSON-1404738214 Sep 06 21:13:54.626946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 8e2d0b17f13b4989bbb230a60d6c5662 Sep 06 21:13:54.626946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesGetTestJSON-1404738214 Sep 06 21:13:54.626946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User: tempest-VolumesGetTestJSON-1404738214-project Sep 06 21:13:54.626946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 06 21:13:54.626946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 06 21:13:54.626946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Id: 8f011304deec4c798bff42fbb8cf4c09 Sep 06 21:13:54.626946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-VolumesGetTestJSON-1404738214-project Sep 06 21:13:54.626946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: method: Sep 06 21:13:54.626946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: exception: Volume 8667673c-66c3-4b16-9769-79fa5f7782c5 could not be found. Sep 06 21:13:54.626946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: action_args: {'id': '8667673c-66c3-4b16-9769-79fa5f7782c5'} Sep 06 21:13:54.626946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:13:54.627668 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:13:54.627668 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 21:13:54.627668 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 21:13:54.627668 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 21:13:54.627668 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 21:13:54.627668 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 21:13:54.627668 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 21:13:54.627668 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 21:13:54.627668 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 21:13:54.627668 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 21:13:54.627668 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 21:13:54.627668 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 21:13:54.627668 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 21:13:54.627668 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 21:13:54.627668 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 21:13:54.627668 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8667673c-66c3-4b16-9769-79fa5f7782c5 could not be found. (HTTP 404) (Request-ID: req-b1d734ef-658e-42b6-b726-d1da55d90ac1) Sep 06 21:13:54.627668 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:13:54.627668 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:13:54.627668 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:13:54.628723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:13:54.628723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 21:13:54.628723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 21:13:54.628723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 21:13:54.628723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 21:13:54.628723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 21:13:54.628723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 21:13:54.628723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 21:13:54.628723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 21:13:54.628723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 21:13:54.628723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 21:13:54.628723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 21:13:54.628723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 21:13:54.628723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 21:13:54.628723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 21:13:54.628723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 21:13:54.628723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 21:13:54.628723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 21:13:54.628723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 21:13:54.629633 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 21:13:54.629633 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 21:13:54.629633 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 21:13:54.629633 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 21:13:54.629633 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8667673c-66c3-4b16-9769-79fa5f7782c5 could not be found. Sep 06 21:13:54.629633 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:13:54.629633 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:13:54.629633 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:13:54.629633 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:13:54.629633 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:13:54.629633 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:13:54.629633 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:13:54.629633 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:13:54.629633 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 21:13:54.629633 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 21:13:54.629633 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:13:54.629633 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:13:54.629633 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 21:13:54.629633 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:13:54.630491 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8667673c-66c3-4b16-9769-79fa5f7782c5 could not be found. Sep 06 21:13:54.630491 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:13:54.630491 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:13:54.630491 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:13:54.630491 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:13:54.630491 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:13:54.630491 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:13:54.630491 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:13:54.630491 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:13:54.630491 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8667673c-66c3-4b16-9769-79fa5f7782c5 could not be found. Sep 06 21:13:54.630491 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:13:54.632199 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-63f34b90-8a5a-42db-b0b9-3a5081095aa4 tempest-VolumesGetTestJSON-1404738214 tempest-VolumesGetTestJSON-1404738214-project] Returning 404 to user: Volume 8667673c-66c3-4b16-9769-79fa5f7782c5 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:13:54.633443 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-63f34b90-8a5a-42db-b0b9-3a5081095aa4 tempest-VolumesGetTestJSON-1404738214 tempest-VolumesGetTestJSON-1404738214-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/8667673c-66c3-4b16-9769-79fa5f7782c5" status: 404 len: 109 microversion: 2.1 time: 0.088074 Sep 06 21:13:54.637746 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 15/31] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Sep 6 21:13:54 2022] GET /compute/v2.1/os-volumes/8667673c-66c3-4b16-9769-79fa5f7782c5 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 21:13:54.688240 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0c010baf-71ed-46ea-91ab-bdbf171a3153 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/7bfca415-6bfd-4088-b257-90fcc19297f4" status: 200 len: 343 microversion: 2.1 time: 0.123242 Sep 06 21:13:54.689481 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 17/32] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Sep 6 21:13:54 2022] GET /compute/v2.1/os-volumes/7bfca415-6bfd-4088-b257-90fcc19297f4 => generated 343 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:13:55.705812 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9c709387-9fca-4e6a-b925-71624cff6683 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Calling method '.version_select at 0x7f04cf462790>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:55.810692 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9c709387-9fca-4e6a-b925-71624cff6683 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/7bfca415-6bfd-4088-b257-90fcc19297f4" status: 200 len: 343 microversion: 2.1 time: 0.109559 Sep 06 21:13:55.811610 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 16/33] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Sep 6 21:13:55 2022] GET /compute/v2.1/os-volumes/7bfca415-6bfd-4088-b257-90fcc19297f4 => generated 343 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:13:56.017106 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7348cf42-b4d0-4607-8e4d-1386dc4ad493 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Action: 'create', calling method: .version_select at 0x7f04cf374e50>, body: {"keypair": {"name": "tempest-keypair-143609311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpYnOWIm6b1Pb9qHpcQODDXXit1yy7vDOmYEu62X2HnYHtUYuWpuDPxcfIldz8MvjP+29kBZVxvr1nVUTs+KkYiF9Mud67akiEQDw/v42uq6y8295wkav+tLaJOYEyyLw=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:13:56.069877 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-7348cf42-b4d0-4607-8e4d-1386dc4ad493 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Getting quotas for project cabcd82424984a0ba003e5324b505e54. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:13:56.091715 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-7348cf42-b4d0-4607-8e4d-1386dc4ad493 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Getting quotas for user 64033668b9fd4ba48eef09bdc3fdf2ee and project cabcd82424984a0ba003e5324b505e54. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:13:56.148005 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7348cf42-b4d0-4607-8e4d-1386dc4ad493 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.382195 Sep 06 21:13:56.171592 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 18/34] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Sep 6 21:13:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:13:56.828513 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b0c771f8-f7c6-404b-964c-1ac051a1316b tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Calling method '.version_select at 0x7f04cf383f70>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:56.947906 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b0c771f8-f7c6-404b-964c-1ac051a1316b tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/7bfca415-6bfd-4088-b257-90fcc19297f4" status: 200 len: 343 microversion: 2.1 time: 0.125594 Sep 06 21:13:56.949235 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 19/35] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Sep 6 21:13:56 2022] GET /compute/v2.1/os-volumes/7bfca415-6bfd-4088-b257-90fcc19297f4 => generated 343 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:13:57.134016 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2fc89319-e1ed-4aa5-afcb-4c7c37eaac20 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1176477304", "imageRef": "8b4a7612-517c-4711-8637-36b221338f65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:13:57.334339 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-2fc89319-e1ed-4aa5-afcb-4c7c37eaac20 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] validate_networks() for [('ebd3cadb-0399-42a5-9075-83a55d051ee3', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 21:13:57.963133 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-da1cab48-e75f-4f90-a5ff-8e46e57ec6b9 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Calling method '.version_select at 0x7f04cf3855e0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:13:58.084931 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-da1cab48-e75f-4f90-a5ff-8e46e57ec6b9 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/7bfca415-6bfd-4088-b257-90fcc19297f4" status: 200 len: 343 microversion: 2.1 time: 0.125852 Sep 06 21:13:58.085728 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 20/36] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Sep 6 21:13:57 2022] GET /compute/v2.1/os-volumes/7bfca415-6bfd-4088-b257-90fcc19297f4 => generated 343 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:13:59.338347 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c54c74de-7fa9-4515-a657-72df4f74a98e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-896704816", "imageRef": "8b4a7612-517c-4711-8637-36b221338f65", "flavorRef": "452", "networks": [{"uuid": "920998b7-4ea3-47d0-b64b-50bd8721e7e9"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:13:59.490682 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-c54c74de-7fa9-4515-a657-72df4f74a98e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] validate_networks() for [('920998b7-4ea3-47d0-b64b-50bd8721e7e9', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 21:14:00.331185 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-2fc89319-e1ed-4aa5-afcb-4c7c37eaac20 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 21:14:00.331762 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-2fc89319-e1ed-4aa5-afcb-4c7c37eaac20 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 21:14:00.333161 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-2fc89319-e1ed-4aa5-afcb-4c7c37eaac20 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 21:14:00.334602 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-2fc89319-e1ed-4aa5-afcb-4c7c37eaac20 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 21:14:00.334716 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-2fc89319-e1ed-4aa5-afcb-4c7c37eaac20 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 21:14:00.376219 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fc89319-e1ed-4aa5-afcb-4c7c37eaac20 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:00.376856 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fc89319-e1ed-4aa5-afcb-4c7c37eaac20 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:00.377472 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fc89319-e1ed-4aa5-afcb-4c7c37eaac20 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:00.378390 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fc89319-e1ed-4aa5-afcb-4c7c37eaac20 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:00.379167 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fc89319-e1ed-4aa5-afcb-4c7c37eaac20 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:00.379728 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fc89319-e1ed-4aa5-afcb-4c7c37eaac20 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:00.417510 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-2fc89319-e1ed-4aa5-afcb-4c7c37eaac20 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Getting quotas for project ff397d6b3f4a42bf8b68b3bc55600dba. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:14:00.425846 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-2fc89319-e1ed-4aa5-afcb-4c7c37eaac20 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Getting quotas for user 2ec47d6e2e9b40a6bd207c084041f7a9 and project ff397d6b3f4a42bf8b68b3bc55600dba. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:14:00.442454 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2fc89319-e1ed-4aa5-afcb-4c7c37eaac20 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 21:14:00.446182 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2fc89319-e1ed-4aa5-afcb-4c7c37eaac20 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8b4a7612-517c-4711-8637-36b221338f65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 21:14:00.607421 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2fc89319-e1ed-4aa5-afcb-4c7c37eaac20 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.794858 Sep 06 21:14:00.611560 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 17/37] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Sep 6 21:13:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 3800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 21:14:00.618885 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-64191ce1-5f5e-4db6-9315-0c90b7df39b7 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Calling method '.version_select at 0x7f04cf2e1280>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:00.706482 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-64191ce1-5f5e-4db6-9315-0c90b7df39b7 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] HTTP exception thrown: Volume 7bfca415-6bfd-4088-b257-90fcc19297f4 could not be found. Sep 06 21:14:00.708841 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-64191ce1-5f5e-4db6-9315-0c90b7df39b7 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Request method failure captured: Sep 06 21:14:00.708841 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/os-volumes/7bfca415-6bfd-4088-b257-90fcc19297f4 HTTP/1.1 Sep 06 21:14:00.708841 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 06 21:14:00.708841 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 06 21:14:00.708841 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Connection: close Sep 06 21:14:00.708841 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 06 21:14:00.708841 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 06 21:14:00.708841 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Host: 10.222.0.79 Sep 06 21:14:00.708841 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 06 21:14:00.708841 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 06 21:14:00.708841 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjF7gEi1Sqp2mclISXqF8t4-HP1GpYhbqJX3xPnALyZYXlDwoN9RpTCs1WIOAlu4mdYeoZktIngpjUciqOtgkWm0l2ZwbIz4ziOIfWNM00Ug-94O7UL0JuVKSXg_wBXt2tmuqWan_SCS3oWuAZZJrxG5GIjjUBQMlXDodLscJ3Q9KfYLg Sep 06 21:14:00.708841 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 06 21:14:00.708841 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 06 21:14:00.708841 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 06 21:14:00.708841 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 06 21:14:00.708841 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 06 21:14:00.708841 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 06 21:14:00.708841 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Id: 8ba0f5f714694c249c785253abd18dc8 Sep 06 21:14:00.708841 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1973155764 Sep 06 21:14:00.708841 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Role: reader,member Sep 06 21:14:00.708841 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Sep 06 21:14:00.710223 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8ba0f5f714694c249c785253abd18dc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8ba0f5f714694c249c785253abd18dc8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8ba0f5f714694c249c785253abd18dc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8ba0f5f714694c249c785253abd18dc8"}]}] Sep 06 21:14:00.710223 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1973155764 Sep 06 21:14:00.710223 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 8ba0f5f714694c249c785253abd18dc8 Sep 06 21:14:00.710223 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1973155764 Sep 06 21:14:00.710223 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User: tempest-VolumesSnapshotsTestJSON-1973155764-project Sep 06 21:14:00.710223 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 06 21:14:00.710223 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 06 21:14:00.710223 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Id: 8bf3e32edd3a41daaecfe6c73a761363 Sep 06 21:14:00.710223 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1973155764-project Sep 06 21:14:00.710223 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: method: Sep 06 21:14:00.710223 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: exception: Volume 7bfca415-6bfd-4088-b257-90fcc19297f4 could not be found. Sep 06 21:14:00.710223 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: action_args: {'id': '7bfca415-6bfd-4088-b257-90fcc19297f4'} Sep 06 21:14:00.710223 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:14:00.711055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:00.711055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 21:14:00.711055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 21:14:00.711055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 21:14:00.711055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 21:14:00.711055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 21:14:00.711055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 21:14:00.711055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 21:14:00.711055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 21:14:00.711055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 21:14:00.711055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 21:14:00.711055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 21:14:00.711055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 21:14:00.711055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 21:14:00.711055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 21:14:00.711055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7bfca415-6bfd-4088-b257-90fcc19297f4 could not be found. (HTTP 404) (Request-ID: req-87d9f61f-95d6-476e-a1ce-b0be2cd7a21c) Sep 06 21:14:00.711055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:14:00.711055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:14:00.711055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:14:00.712015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:00.712015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 21:14:00.712015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 21:14:00.712015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 21:14:00.712015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 21:14:00.712015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 21:14:00.712015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 21:14:00.712015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 21:14:00.712015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 21:14:00.712015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 21:14:00.712015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 21:14:00.712015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 21:14:00.712015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 21:14:00.712015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 21:14:00.712015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 21:14:00.712015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 21:14:00.712015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 21:14:00.712015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 21:14:00.712015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 21:14:00.712959 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 21:14:00.712959 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 21:14:00.712959 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 21:14:00.712959 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 21:14:00.712959 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7bfca415-6bfd-4088-b257-90fcc19297f4 could not be found. Sep 06 21:14:00.712959 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:14:00.712959 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:14:00.712959 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:14:00.712959 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:00.712959 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:14:00.712959 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:14:00.712959 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:14:00.712959 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:14:00.712959 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 21:14:00.712959 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 21:14:00.712959 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:14:00.712959 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:14:00.712959 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 21:14:00.712959 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:14:00.714033 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7bfca415-6bfd-4088-b257-90fcc19297f4 could not be found. Sep 06 21:14:00.714033 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:14:00.714033 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:14:00.714033 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:14:00.714033 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:00.714033 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:14:00.714033 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:14:00.714033 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:14:00.714033 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:14:00.714033 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7bfca415-6bfd-4088-b257-90fcc19297f4 could not be found. Sep 06 21:14:00.714033 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:14:00.714033 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-64191ce1-5f5e-4db6-9315-0c90b7df39b7 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Returning 404 to user: Volume 7bfca415-6bfd-4088-b257-90fcc19297f4 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:14:00.714033 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-64191ce1-5f5e-4db6-9315-0c90b7df39b7 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/7bfca415-6bfd-4088-b257-90fcc19297f4" status: 404 len: 109 microversion: 2.1 time: 0.096600 Sep 06 21:14:00.714033 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 18/38] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Sep 6 21:14:00 2022] GET /compute/v2.1/os-volumes/7bfca415-6bfd-4088-b257-90fcc19297f4 => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:14:00.725457 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d9af5258-b5ad-46db-bf18-756d94d84129 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:00.731694 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d9af5258-b5ad-46db-bf18-756d94d84129 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:01.059351 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d9af5258-b5ad-46db-bf18-756d94d84129 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:01.102797 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d9af5258-b5ad-46db-bf18-756d94d84129 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1222 microversion: 2.1 time: 0.390658 Sep 06 21:14:01.120217 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 19/39] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:00 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1222 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:01.137483 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d266aa28-7c85-4eba-afc6-489f3cd2bfa9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1582976656", "imageRef": "8b4a7612-517c-4711-8637-36b221338f65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8251999f-dd53-4ed2-8c61-ea9e082ce54a"}], "security_groups": [{"name": "tempest-securitygroup--119217374"}], "key_name": "tempest-keypair-1797284754", "user_data": "}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:14:01.486903 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-d266aa28-7c85-4eba-afc6-489f3cd2bfa9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] validate_networks() for [('8251999f-dd53-4ed2-8c61-ea9e082ce54a', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 21:14:01.911457 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-c54c74de-7fa9-4515-a657-72df4f74a98e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 21:14:01.912025 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-c54c74de-7fa9-4515-a657-72df4f74a98e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 21:14:01.912348 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-c54c74de-7fa9-4515-a657-72df4f74a98e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 21:14:01.912774 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-c54c74de-7fa9-4515-a657-72df4f74a98e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 21:14:01.913520 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-c54c74de-7fa9-4515-a657-72df4f74a98e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 21:14:01.934023 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c54c74de-7fa9-4515-a657-72df4f74a98e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:01.939639 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c54c74de-7fa9-4515-a657-72df4f74a98e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:01.940392 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c54c74de-7fa9-4515-a657-72df4f74a98e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:01.941947 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c54c74de-7fa9-4515-a657-72df4f74a98e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:01.942567 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c54c74de-7fa9-4515-a657-72df4f74a98e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:01.943149 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c54c74de-7fa9-4515-a657-72df4f74a98e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:02.009083 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-c54c74de-7fa9-4515-a657-72df4f74a98e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Getting quotas for project a2ec2d845bf247a6b463e59e513dd936. Resources: {'ram', 'cores', 'instances'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:14:02.026745 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-c54c74de-7fa9-4515-a657-72df4f74a98e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Getting quotas for user c914e6a41ccc48f49194d57551bdf0d4 and project a2ec2d845bf247a6b463e59e513dd936. Resources: {'ram', 'cores', 'instances'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:14:02.079446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c54c74de-7fa9-4515-a657-72df4f74a98e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 21:14:02.089112 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c54c74de-7fa9-4515-a657-72df4f74a98e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8b4a7612-517c-4711-8637-36b221338f65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 21:14:02.240119 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c54c74de-7fa9-4515-a657-72df4f74a98e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.180686 Sep 06 21:14:02.241994 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 21/40] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Sep 6 21:13:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3188 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 21:14:02.261221 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-089cf971-b0af-468e-b354-7743a238a474 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Calling method '.version_select at 0x7f04ceaa5670>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:02.359271 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-089cf971-b0af-468e-b354-7743a238a474 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] HTTP exception thrown: Volume 7bfca415-6bfd-4088-b257-90fcc19297f4 could not be found. Sep 06 21:14:02.366308 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-089cf971-b0af-468e-b354-7743a238a474 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Request method failure captured: Sep 06 21:14:02.366308 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: DELETE /compute/v2.1/os-volumes/7bfca415-6bfd-4088-b257-90fcc19297f4 HTTP/1.1 Sep 06 21:14:02.366308 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:14:02.366308 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:14:02.366308 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:14:02.366308 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:14:02.366308 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:14:02.366308 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:14:02.366308 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:14:02.366308 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:14:02.366308 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7gEi1Sqp2mclISXqF8t4-HP1GpYhbqJX3xPnALyZYXlDwoN9RpTCs1WIOAlu4mdYeoZktIngpjUciqOtgkWm0l2ZwbIz4ziOIfWNM00Ug-94O7UL0JuVKSXg_wBXt2tmuqWan_SCS3oWuAZZJrxG5GIjjUBQMlXDodLscJ3Q9KfYLg Sep 06 21:14:02.366308 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:14:02.366308 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:14:02.366308 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:14:02.366308 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:14:02.366308 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:14:02.366308 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:14:02.366308 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: 8ba0f5f714694c249c785253abd18dc8 Sep 06 21:14:02.366308 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1973155764 Sep 06 21:14:02.366308 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:14:02.366308 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:14:02.367539 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8ba0f5f714694c249c785253abd18dc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8ba0f5f714694c249c785253abd18dc8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8ba0f5f714694c249c785253abd18dc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8ba0f5f714694c249c785253abd18dc8"}]}] Sep 06 21:14:02.367539 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1973155764 Sep 06 21:14:02.367539 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 8ba0f5f714694c249c785253abd18dc8 Sep 06 21:14:02.367539 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1973155764 Sep 06 21:14:02.367539 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-VolumesSnapshotsTestJSON-1973155764-project Sep 06 21:14:02.367539 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:14:02.367539 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:14:02.367539 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: 8bf3e32edd3a41daaecfe6c73a761363 Sep 06 21:14:02.367539 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1973155764-project Sep 06 21:14:02.367539 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: Sep 06 21:14:02.367539 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Volume 7bfca415-6bfd-4088-b257-90fcc19297f4 could not be found. Sep 06 21:14:02.367539 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'id': '7bfca415-6bfd-4088-b257-90fcc19297f4'} Sep 06 21:14:02.367539 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:14:02.368215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:02.368215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 21:14:02.368215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 21:14:02.368215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 21:14:02.368215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 21:14:02.368215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 21:14:02.368215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 21:14:02.368215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 21:14:02.368215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 21:14:02.368215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 21:14:02.368215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 21:14:02.368215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 21:14:02.368215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 21:14:02.368215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 21:14:02.368215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 21:14:02.368215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7bfca415-6bfd-4088-b257-90fcc19297f4 could not be found. (HTTP 404) (Request-ID: req-e61121f1-7580-4ace-9d6f-dc4109af2e37) Sep 06 21:14:02.368215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:02.368215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:14:02.368215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:02.370372 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:02.370372 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 06 21:14:02.370372 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 06 21:14:02.370372 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 21:14:02.370372 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 21:14:02.370372 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 21:14:02.370372 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 21:14:02.370372 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 21:14:02.370372 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 21:14:02.370372 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 21:14:02.370372 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 21:14:02.370372 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 21:14:02.370372 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 21:14:02.370372 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 21:14:02.370372 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 21:14:02.370372 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 21:14:02.370372 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 21:14:02.370372 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 21:14:02.370372 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 21:14:02.371708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 21:14:02.371708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 21:14:02.371708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 21:14:02.371708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 21:14:02.371708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7bfca415-6bfd-4088-b257-90fcc19297f4 could not be found. Sep 06 21:14:02.371708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:02.371708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:14:02.371708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:02.371708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:02.371708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:14:02.371708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:14:02.371708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:14:02.371708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:14:02.371708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 21:14:02.371708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 21:14:02.371708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:14:02.371708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:14:02.371708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 06 21:14:02.371708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:14:02.373115 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7bfca415-6bfd-4088-b257-90fcc19297f4 could not be found. Sep 06 21:14:02.373115 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:02.373115 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:14:02.373115 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:02.373115 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:02.373115 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:14:02.373115 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:14:02.373115 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:14:02.373115 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:14:02.373115 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7bfca415-6bfd-4088-b257-90fcc19297f4 could not be found. Sep 06 21:14:02.373115 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:02.374943 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-089cf971-b0af-468e-b354-7743a238a474 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Returning 404 to user: Volume 7bfca415-6bfd-4088-b257-90fcc19297f4 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:14:02.377847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-089cf971-b0af-468e-b354-7743a238a474 tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/7bfca415-6bfd-4088-b257-90fcc19297f4" status: 404 len: 109 microversion: 2.1 time: 0.130606 Sep 06 21:14:02.380450 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 22/41] 10.222.0.79 () {58 vars in 1248 bytes} [Tue Sep 6 21:14:02 2022] DELETE /compute/v2.1/os-volumes/7bfca415-6bfd-4088-b257-90fcc19297f4 => generated 109 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:14:02.404823 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a1d48b31-01a9-40ea-9442-8f62339957bb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2039450055", "imageRef": "8b4a7612-517c-4711-8637-36b221338f65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:14:02.558926 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-a1d48b31-01a9-40ea-9442-8f62339957bb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] validate_networks() for [('ebd3cadb-0399-42a5-9075-83a55d051ee3', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 21:14:02.668043 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d266aa28-7c85-4eba-afc6-489f3cd2bfa9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 21:14:02.668610 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d266aa28-7c85-4eba-afc6-489f3cd2bfa9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 21:14:02.670192 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d266aa28-7c85-4eba-afc6-489f3cd2bfa9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 21:14:02.676191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d266aa28-7c85-4eba-afc6-489f3cd2bfa9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 21:14:02.677134 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d266aa28-7c85-4eba-afc6-489f3cd2bfa9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 21:14:02.707680 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d266aa28-7c85-4eba-afc6-489f3cd2bfa9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:02.712831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d266aa28-7c85-4eba-afc6-489f3cd2bfa9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:02.713540 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d266aa28-7c85-4eba-afc6-489f3cd2bfa9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:02.719039 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d266aa28-7c85-4eba-afc6-489f3cd2bfa9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:02.720337 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d266aa28-7c85-4eba-afc6-489f3cd2bfa9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:02.722135 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d266aa28-7c85-4eba-afc6-489f3cd2bfa9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:02.808832 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-d266aa28-7c85-4eba-afc6-489f3cd2bfa9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Getting quotas for project 2e39683d687e424fbed4539cb4040060. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:14:02.824887 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-d266aa28-7c85-4eba-afc6-489f3cd2bfa9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Getting quotas for user 54fe3d99f05c45f099804fccb4679503 and project 2e39683d687e424fbed4539cb4040060. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:14:02.878466 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d266aa28-7c85-4eba-afc6-489f3cd2bfa9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 21:14:02.910985 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d266aa28-7c85-4eba-afc6-489f3cd2bfa9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8b4a7612-517c-4711-8637-36b221338f65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 21:14:03.152022 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d266aa28-7c85-4eba-afc6-489f3cd2bfa9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.026493 Sep 06 21:14:03.160297 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 20/42] 10.222.0.79 () {62 vars in 1188 bytes} [Tue Sep 6 21:14:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 2035 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 06 21:14:03.171087 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2603d5ee-af89-420e-88e4-bb7063295403 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:03.171706 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2603d5ee-af89-420e-88e4-bb7063295403 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:03.452502 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2603d5ee-af89-420e-88e4-bb7063295403 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:03.466380 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2603d5ee-af89-420e-88e4-bb7063295403 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1214 microversion: 2.1 time: 0.304212 Sep 06 21:14:03.470567 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 21/43] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:03 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1214 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:03.487621 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-26f39d9e-e89e-4e28-85df-e606b6a30134 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2060590375", "imageRef": "8b4a7612-517c-4711-8637-36b221338f65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4895ef76-f62c-4485-86de-16d3ba8c928b"}], "security_groups": [{"name": "tempest-securitygroup--998910722"}], "key_name": "tempest-keypair-143609311", "user_data": "}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:14:04.012164 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-a1d48b31-01a9-40ea-9442-8f62339957bb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 21:14:04.012826 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-a1d48b31-01a9-40ea-9442-8f62339957bb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 21:14:04.015203 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-a1d48b31-01a9-40ea-9442-8f62339957bb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 21:14:04.015949 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-a1d48b31-01a9-40ea-9442-8f62339957bb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 21:14:04.016739 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-a1d48b31-01a9-40ea-9442-8f62339957bb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 21:14:04.062327 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1d48b31-01a9-40ea-9442-8f62339957bb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:04.064997 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1d48b31-01a9-40ea-9442-8f62339957bb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:04.065411 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1d48b31-01a9-40ea-9442-8f62339957bb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:04.069217 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1d48b31-01a9-40ea-9442-8f62339957bb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:04.069711 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1d48b31-01a9-40ea-9442-8f62339957bb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:04.072390 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1d48b31-01a9-40ea-9442-8f62339957bb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:04.124434 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-26f39d9e-e89e-4e28-85df-e606b6a30134 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] validate_networks() for [('4895ef76-f62c-4485-86de-16d3ba8c928b', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 21:14:04.196669 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-a1d48b31-01a9-40ea-9442-8f62339957bb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Getting quotas for project ff397d6b3f4a42bf8b68b3bc55600dba. Resources: {'ram', 'cores', 'instances'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:14:04.212621 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-a1d48b31-01a9-40ea-9442-8f62339957bb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Getting quotas for user 2ec47d6e2e9b40a6bd207c084041f7a9 and project ff397d6b3f4a42bf8b68b3bc55600dba. Resources: {'ram', 'cores', 'instances'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:14:04.291453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a1d48b31-01a9-40ea-9442-8f62339957bb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 21:14:04.297516 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a1d48b31-01a9-40ea-9442-8f62339957bb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8b4a7612-517c-4711-8637-36b221338f65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 21:14:04.523373 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a1d48b31-01a9-40ea-9442-8f62339957bb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.140569 Sep 06 21:14:04.528641 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 23/44] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Sep 6 21:14:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 2148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 21:14:04.536901 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-24b7c948-2d9d-477a-acd6-6279fbaf3d1b tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Calling method '.version_select at 0x7f04cea8e3a0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:04.657726 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-24b7c948-2d9d-477a-acd6-6279fbaf3d1b tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] HTTP exception thrown: Volume 7bfca415-6bfd-4088-b257-90fcc19297f4 could not be found. Sep 06 21:14:04.660332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-24b7c948-2d9d-477a-acd6-6279fbaf3d1b tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Request method failure captured: Sep 06 21:14:04.660332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/os-volumes/7bfca415-6bfd-4088-b257-90fcc19297f4 HTTP/1.1 Sep 06 21:14:04.660332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:14:04.660332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:14:04.660332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:14:04.660332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:14:04.660332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:14:04.660332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:14:04.660332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:14:04.660332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:14:04.660332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7gEi1Sqp2mclISXqF8t4-HP1GpYhbqJX3xPnALyZYXlDwoN9RpTCs1WIOAlu4mdYeoZktIngpjUciqOtgkWm0l2ZwbIz4ziOIfWNM00Ug-94O7UL0JuVKSXg_wBXt2tmuqWan_SCS3oWuAZZJrxG5GIjjUBQMlXDodLscJ3Q9KfYLg Sep 06 21:14:04.660332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:14:04.660332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:14:04.660332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:14:04.660332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:14:04.660332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:14:04.660332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:14:04.660332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: 8ba0f5f714694c249c785253abd18dc8 Sep 06 21:14:04.660332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1973155764 Sep 06 21:14:04.660332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:14:04.660332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:14:04.662016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8ba0f5f714694c249c785253abd18dc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8ba0f5f714694c249c785253abd18dc8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8ba0f5f714694c249c785253abd18dc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8ba0f5f714694c249c785253abd18dc8"}]}] Sep 06 21:14:04.662016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1973155764 Sep 06 21:14:04.662016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 8ba0f5f714694c249c785253abd18dc8 Sep 06 21:14:04.662016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1973155764 Sep 06 21:14:04.662016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-VolumesSnapshotsTestJSON-1973155764-project Sep 06 21:14:04.662016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:14:04.662016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:14:04.662016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: 8bf3e32edd3a41daaecfe6c73a761363 Sep 06 21:14:04.662016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1973155764-project Sep 06 21:14:04.662016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: Sep 06 21:14:04.662016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Volume 7bfca415-6bfd-4088-b257-90fcc19297f4 could not be found. Sep 06 21:14:04.662016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'id': '7bfca415-6bfd-4088-b257-90fcc19297f4'} Sep 06 21:14:04.662016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:14:04.662719 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:04.662719 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 21:14:04.662719 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 21:14:04.662719 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 21:14:04.662719 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 21:14:04.662719 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 21:14:04.662719 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 21:14:04.662719 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 21:14:04.662719 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 21:14:04.662719 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 21:14:04.662719 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 21:14:04.662719 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 21:14:04.662719 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 21:14:04.662719 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 21:14:04.662719 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 21:14:04.662719 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7bfca415-6bfd-4088-b257-90fcc19297f4 could not be found. (HTTP 404) (Request-ID: req-a2a76a41-1cae-476a-869d-1e1458679a76) Sep 06 21:14:04.662719 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:04.662719 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:14:04.662719 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:04.663686 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:04.663686 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 21:14:04.663686 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 21:14:04.663686 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 21:14:04.663686 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 21:14:04.663686 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 21:14:04.663686 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 21:14:04.663686 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 21:14:04.663686 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 21:14:04.663686 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 21:14:04.663686 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 21:14:04.663686 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 21:14:04.663686 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 21:14:04.663686 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 21:14:04.663686 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 21:14:04.663686 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 21:14:04.663686 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 21:14:04.663686 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 21:14:04.663686 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 21:14:04.664614 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 21:14:04.664614 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 21:14:04.664614 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 21:14:04.664614 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 21:14:04.664614 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7bfca415-6bfd-4088-b257-90fcc19297f4 could not be found. Sep 06 21:14:04.664614 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:04.664614 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:14:04.664614 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:04.664614 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:04.664614 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:14:04.664614 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:14:04.664614 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:14:04.664614 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:14:04.664614 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 21:14:04.664614 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 21:14:04.664614 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:14:04.664614 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:14:04.664614 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 21:14:04.664614 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:14:04.668154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7bfca415-6bfd-4088-b257-90fcc19297f4 could not be found. Sep 06 21:14:04.668154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:04.668154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:14:04.668154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:04.668154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:04.668154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:14:04.668154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:14:04.668154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:14:04.668154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:14:04.668154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7bfca415-6bfd-4088-b257-90fcc19297f4 could not be found. Sep 06 21:14:04.668154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:04.671201 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-24b7c948-2d9d-477a-acd6-6279fbaf3d1b tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] Returning 404 to user: Volume 7bfca415-6bfd-4088-b257-90fcc19297f4 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:14:04.672787 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-24b7c948-2d9d-477a-acd6-6279fbaf3d1b tempest-VolumesSnapshotsTestJSON-1973155764 tempest-VolumesSnapshotsTestJSON-1973155764-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/7bfca415-6bfd-4088-b257-90fcc19297f4" status: 404 len: 109 microversion: 2.1 time: 0.140430 Sep 06 21:14:04.673829 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 24/45] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Sep 6 21:14:04 2022] GET /compute/v2.1/os-volumes/7bfca415-6bfd-4088-b257-90fcc19297f4 => generated 109 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:14:04.705048 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eb8eabab-9ca5-4194-b3da-47df0d5816f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:04.705829 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-eb8eabab-9ca5-4194-b3da-47df0d5816f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:04.750846 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb8eabab-9ca5-4194-b3da-47df0d5816f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:04.751360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb8eabab-9ca5-4194-b3da-47df0d5816f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:04.759241 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb8eabab-9ca5-4194-b3da-47df0d5816f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:04.760186 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb8eabab-9ca5-4194-b3da-47df0d5816f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:04.763384 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb8eabab-9ca5-4194-b3da-47df0d5816f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:04.764778 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb8eabab-9ca5-4194-b3da-47df0d5816f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:05.341492 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-26f39d9e-e89e-4e28-85df-e606b6a30134 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 21:14:05.342788 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-26f39d9e-e89e-4e28-85df-e606b6a30134 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 21:14:05.343560 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-26f39d9e-e89e-4e28-85df-e606b6a30134 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 21:14:05.344586 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-26f39d9e-e89e-4e28-85df-e606b6a30134 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 21:14:05.345622 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-26f39d9e-e89e-4e28-85df-e606b6a30134 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 21:14:05.358780 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26f39d9e-e89e-4e28-85df-e606b6a30134 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:05.360971 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26f39d9e-e89e-4e28-85df-e606b6a30134 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:05.362392 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26f39d9e-e89e-4e28-85df-e606b6a30134 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:05.363811 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26f39d9e-e89e-4e28-85df-e606b6a30134 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:05.364569 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26f39d9e-e89e-4e28-85df-e606b6a30134 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:05.365260 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26f39d9e-e89e-4e28-85df-e606b6a30134 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:05.393075 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-26f39d9e-e89e-4e28-85df-e606b6a30134 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Getting quotas for project cabcd82424984a0ba003e5324b505e54. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:14:05.400837 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-26f39d9e-e89e-4e28-85df-e606b6a30134 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Getting quotas for user 64033668b9fd4ba48eef09bdc3fdf2ee and project cabcd82424984a0ba003e5324b505e54. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:14:05.420967 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-26f39d9e-e89e-4e28-85df-e606b6a30134 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 21:14:05.428139 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-26f39d9e-e89e-4e28-85df-e606b6a30134 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8b4a7612-517c-4711-8637-36b221338f65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 21:14:05.510065 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-eb8eabab-9ca5-4194-b3da-47df0d5816f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:05.598301 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-eb8eabab-9ca5-4194-b3da-47df0d5816f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:05.602681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-eb8eabab-9ca5-4194-b3da-47df0d5816f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:05.614957 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-eb8eabab-9ca5-4194-b3da-47df0d5816f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1278 microversion: 2.20 time: 0.935354 Sep 06 21:14:05.615819 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 25/46] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:04 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1278 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:05.618562 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-26f39d9e-e89e-4e28-85df-e606b6a30134 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.146678 Sep 06 21:14:05.624806 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 22/47] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Sep 6 21:14:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 2153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 21:14:05.637997 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d231a771-f74c-420f-882f-5846236f1df7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:05.641122 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fc3c48e8-d9bd-4699-a1bd-975385a370f1 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:05.645685 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fc3c48e8-d9bd-4699-a1bd-975385a370f1 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:05.651611 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d231a771-f74c-420f-882f-5846236f1df7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:05.674262 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc3c48e8-d9bd-4699-a1bd-975385a370f1 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:05.680907 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc3c48e8-d9bd-4699-a1bd-975385a370f1 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:05.682411 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc3c48e8-d9bd-4699-a1bd-975385a370f1 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:05.686434 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d231a771-f74c-420f-882f-5846236f1df7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:05.686700 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc3c48e8-d9bd-4699-a1bd-975385a370f1 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:05.687691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc3c48e8-d9bd-4699-a1bd-975385a370f1 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:05.688297 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d231a771-f74c-420f-882f-5846236f1df7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:05.688957 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d231a771-f74c-420f-882f-5846236f1df7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:05.689402 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc3c48e8-d9bd-4699-a1bd-975385a370f1 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:05.692196 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d231a771-f74c-420f-882f-5846236f1df7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:05.695928 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d231a771-f74c-420f-882f-5846236f1df7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:05.698063 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d231a771-f74c-420f-882f-5846236f1df7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:05.960261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-fc3c48e8-d9bd-4699-a1bd-975385a370f1 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:05.973916 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fc3c48e8-d9bd-4699-a1bd-975385a370f1 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1210 microversion: 2.1 time: 0.352260 Sep 06 21:14:05.978208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 26/48] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:05 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1210 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:05.988292 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-37844883-8a53-47a4-b929-bbc4c7be35ca tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:05.991201 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-37844883-8a53-47a4-b929-bbc4c7be35ca tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:06.133886 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d231a771-f74c-420f-882f-5846236f1df7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:06.162612 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-37844883-8a53-47a4-b929-bbc4c7be35ca tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:06.179554 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-37844883-8a53-47a4-b929-bbc4c7be35ca tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1237 microversion: 2.1 time: 0.199616 Sep 06 21:14:06.180500 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 27/49] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:05 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1237 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:06.188906 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d231a771-f74c-420f-882f-5846236f1df7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1226 microversion: 2.1 time: 0.552478 Sep 06 21:14:06.190934 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 23/50] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:05 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1226 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:06.645463 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4ac44c4e-917a-4f6e-a884-33f775040ffb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:06.646241 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4ac44c4e-917a-4f6e-a884-33f775040ffb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:06.660573 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ac44c4e-917a-4f6e-a884-33f775040ffb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:06.664169 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ac44c4e-917a-4f6e-a884-33f775040ffb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:06.666654 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ac44c4e-917a-4f6e-a884-33f775040ffb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:06.669689 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ac44c4e-917a-4f6e-a884-33f775040ffb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:06.672382 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ac44c4e-917a-4f6e-a884-33f775040ffb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:06.674182 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4ac44c4e-917a-4f6e-a884-33f775040ffb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:06.813701 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4ac44c4e-917a-4f6e-a884-33f775040ffb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:06.825893 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4ac44c4e-917a-4f6e-a884-33f775040ffb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:06.834550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4ac44c4e-917a-4f6e-a884-33f775040ffb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:06.837870 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4ac44c4e-917a-4f6e-a884-33f775040ffb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1334 microversion: 2.20 time: 0.197973 Sep 06 21:14:06.840941 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 28/51] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:06 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1334 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:07.007555 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f4f83fcb-abbb-4cb3-b251-cb0d34f476e8 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:07.008955 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f4f83fcb-abbb-4cb3-b251-cb0d34f476e8 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:07.022413 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4f83fcb-abbb-4cb3-b251-cb0d34f476e8 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:07.029068 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4f83fcb-abbb-4cb3-b251-cb0d34f476e8 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:07.032221 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4f83fcb-abbb-4cb3-b251-cb0d34f476e8 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:07.033503 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4f83fcb-abbb-4cb3-b251-cb0d34f476e8 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:07.034906 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4f83fcb-abbb-4cb3-b251-cb0d34f476e8 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:07.037236 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4f83fcb-abbb-4cb3-b251-cb0d34f476e8 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:07.206599 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c16b094b-59db-4963-a704-7280a66a7bba tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:07.206824 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c16b094b-59db-4963-a704-7280a66a7bba tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:07.218557 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c16b094b-59db-4963-a704-7280a66a7bba tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:07.229617 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c16b094b-59db-4963-a704-7280a66a7bba tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:07.230486 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c16b094b-59db-4963-a704-7280a66a7bba tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:07.231437 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c16b094b-59db-4963-a704-7280a66a7bba tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:07.232087 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c16b094b-59db-4963-a704-7280a66a7bba tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:07.235092 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c16b094b-59db-4963-a704-7280a66a7bba tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:07.483635 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c16b094b-59db-4963-a704-7280a66a7bba tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:07.498506 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f4f83fcb-abbb-4cb3-b251-cb0d34f476e8 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:07.503846 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c16b094b-59db-4963-a704-7280a66a7bba tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1233 microversion: 2.1 time: 0.301731 Sep 06 21:14:07.508575 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f4f83fcb-abbb-4cb3-b251-cb0d34f476e8 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1210 microversion: 2.1 time: 0.506879 Sep 06 21:14:07.512378 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 24/52] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:07 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1210 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:07.516477 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 29/53] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:07 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1233 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:07.540425 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-966c1d75-0b15-48a3-9db1-0be1cee9a24f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:07.541627 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-966c1d75-0b15-48a3-9db1-0be1cee9a24f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:07.563890 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-966c1d75-0b15-48a3-9db1-0be1cee9a24f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:07.564614 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-966c1d75-0b15-48a3-9db1-0be1cee9a24f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:07.565479 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-966c1d75-0b15-48a3-9db1-0be1cee9a24f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:07.566384 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-966c1d75-0b15-48a3-9db1-0be1cee9a24f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:07.567023 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-966c1d75-0b15-48a3-9db1-0be1cee9a24f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:07.567664 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-966c1d75-0b15-48a3-9db1-0be1cee9a24f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:07.724816 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-966c1d75-0b15-48a3-9db1-0be1cee9a24f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:07.737951 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-966c1d75-0b15-48a3-9db1-0be1cee9a24f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1218 microversion: 2.1 time: 0.224180 Sep 06 21:14:07.738532 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 25/54] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:07 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1218 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:07.877926 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-29106709-24f7-4fa3-a838-60dde7f9d41a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:07.881203 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-29106709-24f7-4fa3-a838-60dde7f9d41a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:07.892928 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29106709-24f7-4fa3-a838-60dde7f9d41a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:07.894025 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29106709-24f7-4fa3-a838-60dde7f9d41a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:07.895432 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29106709-24f7-4fa3-a838-60dde7f9d41a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:07.896178 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29106709-24f7-4fa3-a838-60dde7f9d41a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:07.896677 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29106709-24f7-4fa3-a838-60dde7f9d41a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:07.897248 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29106709-24f7-4fa3-a838-60dde7f9d41a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:08.080267 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-29106709-24f7-4fa3-a838-60dde7f9d41a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:08.113391 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-29106709-24f7-4fa3-a838-60dde7f9d41a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:08.123878 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-29106709-24f7-4fa3-a838-60dde7f9d41a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:08.131318 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-29106709-24f7-4fa3-a838-60dde7f9d41a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1340 microversion: 2.20 time: 0.254978 Sep 06 21:14:08.139156 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 30/55] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:07 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1340 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:08.547598 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-460e9276-ee1c-48d2-9758-aef835b2f1c1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:08.548381 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-460e9276-ee1c-48d2-9758-aef835b2f1c1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:08.550612 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e7257213-5263-43a4-bac0-cf2cec1bf581 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:08.554726 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e7257213-5263-43a4-bac0-cf2cec1bf581 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:08.562440 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-460e9276-ee1c-48d2-9758-aef835b2f1c1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:08.563247 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-460e9276-ee1c-48d2-9758-aef835b2f1c1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:08.564507 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-460e9276-ee1c-48d2-9758-aef835b2f1c1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:08.565849 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-460e9276-ee1c-48d2-9758-aef835b2f1c1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:08.566553 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-460e9276-ee1c-48d2-9758-aef835b2f1c1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:08.567205 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-460e9276-ee1c-48d2-9758-aef835b2f1c1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:08.577502 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7257213-5263-43a4-bac0-cf2cec1bf581 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:08.578250 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7257213-5263-43a4-bac0-cf2cec1bf581 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:08.578940 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7257213-5263-43a4-bac0-cf2cec1bf581 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:08.604894 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7257213-5263-43a4-bac0-cf2cec1bf581 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:08.608192 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7257213-5263-43a4-bac0-cf2cec1bf581 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:08.612598 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7257213-5263-43a4-bac0-cf2cec1bf581 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:08.994943 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-460e9276-ee1c-48d2-9758-aef835b2f1c1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:09.006035 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-460e9276-ee1c-48d2-9758-aef835b2f1c1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1233 microversion: 2.1 time: 0.465968 Sep 06 21:14:09.007653 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 31/56] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:08 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1233 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:09.013306 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6f352ba6-b91b-4855-a619-a79dfd7b2146 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:09.014534 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6f352ba6-b91b-4855-a619-a79dfd7b2146 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:09.022860 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f352ba6-b91b-4855-a619-a79dfd7b2146 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:09.023600 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f352ba6-b91b-4855-a619-a79dfd7b2146 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:09.024505 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f352ba6-b91b-4855-a619-a79dfd7b2146 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:09.025594 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f352ba6-b91b-4855-a619-a79dfd7b2146 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:09.026355 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f352ba6-b91b-4855-a619-a79dfd7b2146 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:09.027012 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f352ba6-b91b-4855-a619-a79dfd7b2146 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:09.111975 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6f352ba6-b91b-4855-a619-a79dfd7b2146 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:09.124228 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6f352ba6-b91b-4855-a619-a79dfd7b2146 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1274 microversion: 2.1 time: 0.114997 Sep 06 21:14:09.125297 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 32/57] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:09 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1274 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:09.163020 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-536ead2d-3991-4531-b6fb-5f53b20da168 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:09.165669 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-536ead2d-3991-4531-b6fb-5f53b20da168 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:09.184740 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-536ead2d-3991-4531-b6fb-5f53b20da168 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:09.186082 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-536ead2d-3991-4531-b6fb-5f53b20da168 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:09.186995 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-536ead2d-3991-4531-b6fb-5f53b20da168 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:09.189499 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-536ead2d-3991-4531-b6fb-5f53b20da168 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:09.193565 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-536ead2d-3991-4531-b6fb-5f53b20da168 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:09.195990 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-536ead2d-3991-4531-b6fb-5f53b20da168 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:09.348967 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e7257213-5263-43a4-bac0-cf2cec1bf581 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:09.365961 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e7257213-5263-43a4-bac0-cf2cec1bf581 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1284 microversion: 2.1 time: 0.825040 Sep 06 21:14:09.381004 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 26/58] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:08 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1284 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:09.555051 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-536ead2d-3991-4531-b6fb-5f53b20da168 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:09.579787 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-536ead2d-3991-4531-b6fb-5f53b20da168 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:09.583450 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-536ead2d-3991-4531-b6fb-5f53b20da168 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:09.589719 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-536ead2d-3991-4531-b6fb-5f53b20da168 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1340 microversion: 2.20 time: 0.431235 Sep 06 21:14:09.599307 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 33/59] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:09 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1340 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 21:14:10.091740 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fd727f2a-1d5a-4bdd-9d55-97ec84a832c2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:10.094254 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fd727f2a-1d5a-4bdd-9d55-97ec84a832c2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:10.119971 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd727f2a-1d5a-4bdd-9d55-97ec84a832c2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:10.119971 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd727f2a-1d5a-4bdd-9d55-97ec84a832c2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:10.119971 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd727f2a-1d5a-4bdd-9d55-97ec84a832c2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:10.119971 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd727f2a-1d5a-4bdd-9d55-97ec84a832c2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:10.126711 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd727f2a-1d5a-4bdd-9d55-97ec84a832c2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:10.127421 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd727f2a-1d5a-4bdd-9d55-97ec84a832c2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:10.175398 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9f15578d-36bf-480a-8317-cf910ae9b7c2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:10.176271 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9f15578d-36bf-480a-8317-cf910ae9b7c2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:10.207278 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f15578d-36bf-480a-8317-cf910ae9b7c2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:10.207776 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f15578d-36bf-480a-8317-cf910ae9b7c2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:10.208212 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f15578d-36bf-480a-8317-cf910ae9b7c2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:10.243357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f15578d-36bf-480a-8317-cf910ae9b7c2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:10.245653 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f15578d-36bf-480a-8317-cf910ae9b7c2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:10.246104 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f15578d-36bf-480a-8317-cf910ae9b7c2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:10.558343 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fd727f2a-1d5a-4bdd-9d55-97ec84a832c2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:10.609877 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fd727f2a-1d5a-4bdd-9d55-97ec84a832c2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1289 microversion: 2.1 time: 0.529174 Sep 06 21:14:10.637219 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 27/60] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:10 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1289 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:10.656519 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-033ac5b7-3a0a-4d45-a2d6-910afd06b272 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:10.675889 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-033ac5b7-3a0a-4d45-a2d6-910afd06b272 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:10.711834 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-033ac5b7-3a0a-4d45-a2d6-910afd06b272 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:10.721149 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-033ac5b7-3a0a-4d45-a2d6-910afd06b272 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:10.722037 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-033ac5b7-3a0a-4d45-a2d6-910afd06b272 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:10.722907 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-033ac5b7-3a0a-4d45-a2d6-910afd06b272 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:10.723370 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-033ac5b7-3a0a-4d45-a2d6-910afd06b272 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:10.723795 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-033ac5b7-3a0a-4d45-a2d6-910afd06b272 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:10.947091 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-033ac5b7-3a0a-4d45-a2d6-910afd06b272 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:10.970495 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-033ac5b7-3a0a-4d45-a2d6-910afd06b272 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1272 microversion: 2.1 time: 0.331716 Sep 06 21:14:10.989891 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 28/61] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:10 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1272 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:11.001243 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d00dd8b5-9c66-4a5d-b234-ce7c50bc16a3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:11.001856 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d00dd8b5-9c66-4a5d-b234-ce7c50bc16a3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:11.018246 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d00dd8b5-9c66-4a5d-b234-ce7c50bc16a3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:11.025247 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d00dd8b5-9c66-4a5d-b234-ce7c50bc16a3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:11.025247 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d00dd8b5-9c66-4a5d-b234-ce7c50bc16a3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:11.025247 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d00dd8b5-9c66-4a5d-b234-ce7c50bc16a3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:11.025247 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d00dd8b5-9c66-4a5d-b234-ce7c50bc16a3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:11.025619 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d00dd8b5-9c66-4a5d-b234-ce7c50bc16a3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:11.142519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9f15578d-36bf-480a-8317-cf910ae9b7c2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:11.161272 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9f15578d-36bf-480a-8317-cf910ae9b7c2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1280 microversion: 2.1 time: 0.989803 Sep 06 21:14:11.182890 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 34/62] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:10 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1280 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:11.207481 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d00dd8b5-9c66-4a5d-b234-ce7c50bc16a3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:11.219819 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d00dd8b5-9c66-4a5d-b234-ce7c50bc16a3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:11.230050 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d00dd8b5-9c66-4a5d-b234-ce7c50bc16a3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:11.232640 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d00dd8b5-9c66-4a5d-b234-ce7c50bc16a3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1340 microversion: 2.20 time: 0.241126 Sep 06 21:14:11.235867 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 29/63] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:10 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1340 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:11.659998 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b682271c-8d8f-4ea7-bae6-7d9b711d312a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:11.661055 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b682271c-8d8f-4ea7-bae6-7d9b711d312a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:11.678354 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b682271c-8d8f-4ea7-bae6-7d9b711d312a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:11.686154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b682271c-8d8f-4ea7-bae6-7d9b711d312a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:11.707296 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b682271c-8d8f-4ea7-bae6-7d9b711d312a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:11.709218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b682271c-8d8f-4ea7-bae6-7d9b711d312a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:11.712918 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b682271c-8d8f-4ea7-bae6-7d9b711d312a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:11.713628 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b682271c-8d8f-4ea7-bae6-7d9b711d312a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:11.987588 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b682271c-8d8f-4ea7-bae6-7d9b711d312a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:12.001430 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b682271c-8d8f-4ea7-bae6-7d9b711d312a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1297 microversion: 2.1 time: 0.347730 Sep 06 21:14:12.001658 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fd40a112-2d28-442f-96a9-b39d41687600 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:12.002361 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fd40a112-2d28-442f-96a9-b39d41687600 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:12.018133 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 35/64] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:11 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1297 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:12.028935 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd40a112-2d28-442f-96a9-b39d41687600 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:12.030921 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd40a112-2d28-442f-96a9-b39d41687600 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:12.031615 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd40a112-2d28-442f-96a9-b39d41687600 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:12.034036 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd40a112-2d28-442f-96a9-b39d41687600 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:12.037923 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd40a112-2d28-442f-96a9-b39d41687600 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:12.038667 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd40a112-2d28-442f-96a9-b39d41687600 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:12.193821 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9a638919-7494-408e-996b-e5c46b10d5ad tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:12.195095 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9a638919-7494-408e-996b-e5c46b10d5ad tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:12.209350 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a638919-7494-408e-996b-e5c46b10d5ad tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:12.212759 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a638919-7494-408e-996b-e5c46b10d5ad tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:12.213354 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a638919-7494-408e-996b-e5c46b10d5ad tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:12.218120 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a638919-7494-408e-996b-e5c46b10d5ad tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:12.220346 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a638919-7494-408e-996b-e5c46b10d5ad tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:12.222726 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a638919-7494-408e-996b-e5c46b10d5ad tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:12.490915 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9a638919-7494-408e-996b-e5c46b10d5ad tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:12.509279 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9a638919-7494-408e-996b-e5c46b10d5ad tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1280 microversion: 2.1 time: 0.311668 Sep 06 21:14:12.510920 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 36/65] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:12 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1280 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:12.516632 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bef7e417-c857-497e-b2ee-46bff8afde85 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:12.521725 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bef7e417-c857-497e-b2ee-46bff8afde85 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:12.554538 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bef7e417-c857-497e-b2ee-46bff8afde85 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:12.555500 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bef7e417-c857-497e-b2ee-46bff8afde85 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:12.556240 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bef7e417-c857-497e-b2ee-46bff8afde85 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:12.557520 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bef7e417-c857-497e-b2ee-46bff8afde85 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:12.559896 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bef7e417-c857-497e-b2ee-46bff8afde85 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:12.560558 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bef7e417-c857-497e-b2ee-46bff8afde85 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:13.017789 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fd40a112-2d28-442f-96a9-b39d41687600 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:13.039156 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fd40a112-2d28-442f-96a9-b39d41687600 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 1.036025 Sep 06 21:14:13.043071 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 30/66] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:11 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:14:13.547346 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a1370706-2eb0-4a69-a6c7-8b8e6b5a8782 tempest-VolumesNegativeTest-1195248011 tempest-VolumesNegativeTest-1195248011-project] Action: 'create', calling method: .version_select at 0x7f04ce984040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1855289078", "metadata": {"Type": "work"}}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:14:13.560262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a1370706-2eb0-4a69-a6c7-8b8e6b5a8782 tempest-VolumesNegativeTest-1195248011 tempest-VolumesNegativeTest-1195248011-project] Request method failure captured: Sep 06 21:14:13.560262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 06 21:14:13.560262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 06 21:14:13.560262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 06 21:14:13.560262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Connection: close Sep 06 21:14:13.560262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Length: 122 Sep 06 21:14:13.560262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 06 21:14:13.560262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Host: 10.222.0.79 Sep 06 21:14:13.560262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 06 21:14:13.560262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 06 21:14:13.560262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjF7gkNv_NoilpXmyhqDd2AvbDX9omOLMVDVGbHK3a4yjamxEDN5rJp-QsD3jieFYx2sdfYvxduqqpaCBMKSEhq1jrvaHaa8FWAN-3FRCsvwQz5yblZ52oqy2uVN1rQPZ8V_8TfROIurwNX7bMnaWpRqcQk3EJfxcsAHxqSYfLjJJU_wE Sep 06 21:14:13.560262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 06 21:14:13.560262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 06 21:14:13.560262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 06 21:14:13.560262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 06 21:14:13.560262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 06 21:14:13.560262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 06 21:14:13.560262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Id: 4674191824504af487e97ada3bd6c17b Sep 06 21:14:13.560262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesNegativeTest-1195248011 Sep 06 21:14:13.560262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Role: reader,member Sep 06 21:14:13.560262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Sep 06 21:14:13.561865 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4674191824504af487e97ada3bd6c17b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4674191824504af487e97ada3bd6c17b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4674191824504af487e97ada3bd6c17b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4674191824504af487e97ada3bd6c17b"}]}] Sep 06 21:14:13.561865 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-VolumesNegativeTest-1195248011 Sep 06 21:14:13.561865 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 4674191824504af487e97ada3bd6c17b Sep 06 21:14:13.561865 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesNegativeTest-1195248011 Sep 06 21:14:13.561865 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User: tempest-VolumesNegativeTest-1195248011-project Sep 06 21:14:13.561865 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 06 21:14:13.561865 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 06 21:14:13.561865 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Id: b31347907161449b806aa08c49565869 Sep 06 21:14:13.561865 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-VolumesNegativeTest-1195248011-project Sep 06 21:14:13.561865 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Sep 06 21:14:13.561865 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1855289078", "metadata": {"Type": "work"}}} Sep 06 21:14:13.561865 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: method: Sep 06 21:14:13.561865 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 06 21:14:13.562766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1855289078', 'metadata': {'Type': 'work'}}}} Sep 06 21:14:13.562766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:14:13.562766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:13.562766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 21:14:13.562766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 21:14:13.562766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 21:14:13.562766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise error Sep 06 21:14:13.562766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 06 21:14:13.562766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:14:13.562766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 06 21:14:13.562766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 06 21:14:13.562766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:14:13.562766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 06 21:14:13.562766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi '#$%' Sep 06 21:14:13.562766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:14:13.562766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:14:13.562766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:14:13.562766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:13.562766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:14:13.562766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:14:13.562766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:14:13.562766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:14:13.564484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 21:14:13.564484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 21:14:13.564484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:14:13.564484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:14:13.564484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 21:14:13.564484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 21:14:13.564484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 21:14:13.564484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 21:14:13.564484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 21:14:13.564484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 21:14:13.564484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 06 21:14:13.564484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:14:13.564484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:14:13.564484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:14:13.564484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:13.564484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:14:13.564484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:14:13.564484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 21:14:13.564484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 21:14:13.565784 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 06 21:14:13.565784 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:14:13.565784 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a1370706-2eb0-4a69-a6c7-8b8e6b5a8782 tempest-VolumesNegativeTest-1195248011 tempest-VolumesNegativeTest-1195248011-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:14:13.566708 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a1370706-2eb0-4a69-a6c7-8b8e6b5a8782 tempest-VolumesNegativeTest-1195248011 tempest-VolumesNegativeTest-1195248011-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.522213 Sep 06 21:14:13.573305 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 31/67] 10.222.0.79 () {60 vars in 1156 bytes} [Tue Sep 6 21:14:13 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 528 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 21:14:13.599867 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-57a70013-8665-4cd3-bc7f-e6d8291b4361 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:13.604608 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-57a70013-8665-4cd3-bc7f-e6d8291b4361 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:13.630062 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57a70013-8665-4cd3-bc7f-e6d8291b4361 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:13.630815 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57a70013-8665-4cd3-bc7f-e6d8291b4361 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:13.633597 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57a70013-8665-4cd3-bc7f-e6d8291b4361 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:13.636781 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57a70013-8665-4cd3-bc7f-e6d8291b4361 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:13.637407 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57a70013-8665-4cd3-bc7f-e6d8291b4361 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:13.638077 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57a70013-8665-4cd3-bc7f-e6d8291b4361 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:13.925837 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-57a70013-8665-4cd3-bc7f-e6d8291b4361 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:13.949631 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-57a70013-8665-4cd3-bc7f-e6d8291b4361 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1295 microversion: 2.1 time: 0.373421 Sep 06 21:14:13.950955 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 32/68] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:13 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1295 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:13.976766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fa7eef6b-57a6-4d05-b5b6-af32f2d60dbe tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:13.979262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fa7eef6b-57a6-4d05-b5b6-af32f2d60dbe tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:14.005229 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa7eef6b-57a6-4d05-b5b6-af32f2d60dbe tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:14.007019 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa7eef6b-57a6-4d05-b5b6-af32f2d60dbe tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:14.008112 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa7eef6b-57a6-4d05-b5b6-af32f2d60dbe tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:14.016421 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa7eef6b-57a6-4d05-b5b6-af32f2d60dbe tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:14.019038 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa7eef6b-57a6-4d05-b5b6-af32f2d60dbe tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:14.019731 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa7eef6b-57a6-4d05-b5b6-af32f2d60dbe tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:14.131413 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:14.199064 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fa7eef6b-57a6-4d05-b5b6-af32f2d60dbe tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:14.228050 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fa7eef6b-57a6-4d05-b5b6-af32f2d60dbe tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1280 microversion: 2.1 time: 0.273427 Sep 06 21:14:14.230252 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 33/69] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:13 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1280 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:14.237773 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-114a9b73-fa3f-40e9-9f06-21cf79722315 tempest-VolumesNegativeTest-1195248011 tempest-VolumesNegativeTest-1195248011-project] Action: 'create', calling method: .version_select at 0x7f04cea11a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1315328668", "metadata": {"Type": "work"}}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:14:14.280671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-114a9b73-fa3f-40e9-9f06-21cf79722315 tempest-VolumesNegativeTest-1195248011 tempest-VolumesNegativeTest-1195248011-project] Request method failure captured: Sep 06 21:14:14.280671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 06 21:14:14.280671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 06 21:14:14.280671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 06 21:14:14.280671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Connection: close Sep 06 21:14:14.280671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Length: 120 Sep 06 21:14:14.280671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 06 21:14:14.280671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Host: 10.222.0.79 Sep 06 21:14:14.280671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 06 21:14:14.280671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 06 21:14:14.280671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjF7gkNv_NoilpXmyhqDd2AvbDX9omOLMVDVGbHK3a4yjamxEDN5rJp-QsD3jieFYx2sdfYvxduqqpaCBMKSEhq1jrvaHaa8FWAN-3FRCsvwQz5yblZ52oqy2uVN1rQPZ8V_8TfROIurwNX7bMnaWpRqcQk3EJfxcsAHxqSYfLjJJU_wE Sep 06 21:14:14.280671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 06 21:14:14.280671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 06 21:14:14.280671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 06 21:14:14.280671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 06 21:14:14.280671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 06 21:14:14.280671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 06 21:14:14.280671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Id: 4674191824504af487e97ada3bd6c17b Sep 06 21:14:14.280671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesNegativeTest-1195248011 Sep 06 21:14:14.280671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Role: reader,member Sep 06 21:14:14.280671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Sep 06 21:14:14.282955 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4674191824504af487e97ada3bd6c17b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4674191824504af487e97ada3bd6c17b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4674191824504af487e97ada3bd6c17b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4674191824504af487e97ada3bd6c17b"}]}] Sep 06 21:14:14.282955 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-VolumesNegativeTest-1195248011 Sep 06 21:14:14.282955 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 4674191824504af487e97ada3bd6c17b Sep 06 21:14:14.282955 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesNegativeTest-1195248011 Sep 06 21:14:14.282955 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User: tempest-VolumesNegativeTest-1195248011-project Sep 06 21:14:14.282955 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 06 21:14:14.282955 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 06 21:14:14.282955 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Id: b31347907161449b806aa08c49565869 Sep 06 21:14:14.282955 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-VolumesNegativeTest-1195248011-project Sep 06 21:14:14.282955 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Sep 06 21:14:14.282955 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1315328668", "metadata": {"Type": "work"}}} Sep 06 21:14:14.282955 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: method: Sep 06 21:14:14.282955 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 06 21:14:14.284262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1315328668', 'metadata': {'Type': 'work'}}}} Sep 06 21:14:14.284262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:14:14.284262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:14.284262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 21:14:14.284262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 21:14:14.284262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 21:14:14.284262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise error Sep 06 21:14:14.284262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 06 21:14:14.284262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.284262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 06 21:14:14.284262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 06 21:14:14.284262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.284262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 06 21:14:14.284262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi '0' Sep 06 21:14:14.284262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.284262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:14:14.284262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.284262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:14.284262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:14:14.284262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:14:14.284262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:14:14.284262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:14:14.285796 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 21:14:14.285796 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 21:14:14.285796 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:14:14.285796 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:14:14.285796 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 21:14:14.285796 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 21:14:14.285796 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 21:14:14.285796 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 21:14:14.285796 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 21:14:14.285796 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 21:14:14.285796 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 06 21:14:14.285796 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.285796 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:14:14.285796 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.285796 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:14.285796 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:14:14.285796 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:14:14.285796 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 21:14:14.285796 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 21:14:14.287059 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 06 21:14:14.287059 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.290553 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-114a9b73-fa3f-40e9-9f06-21cf79722315 tempest-VolumesNegativeTest-1195248011 tempest-VolumesNegativeTest-1195248011-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:14:14.294579 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-114a9b73-fa3f-40e9-9f06-21cf79722315 tempest-VolumesNegativeTest-1195248011 tempest-VolumesNegativeTest-1195248011-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.061528 Sep 06 21:14:14.301293 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 34/70] 10.222.0.79 () {60 vars in 1156 bytes} [Tue Sep 6 21:14:14 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 21:14:14.320197 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1ffb5e78-4a46-43c6-baf3-bf4cce677a66 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:14.325619 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1ffb5e78-4a46-43c6-baf3-bf4cce677a66 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:14.346648 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ffb5e78-4a46-43c6-baf3-bf4cce677a66 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:14.353028 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ffb5e78-4a46-43c6-baf3-bf4cce677a66 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:14.354519 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ffb5e78-4a46-43c6-baf3-bf4cce677a66 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:14.356831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ffb5e78-4a46-43c6-baf3-bf4cce677a66 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:14.359343 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ffb5e78-4a46-43c6-baf3-bf4cce677a66 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:14.360028 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ffb5e78-4a46-43c6-baf3-bf4cce677a66 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:14.477035 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-bef7e417-c857-497e-b2ee-46bff8afde85 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:14.489242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-bef7e417-c857-497e-b2ee-46bff8afde85 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:14.490746 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-bef7e417-c857-497e-b2ee-46bff8afde85 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:14.499785 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bef7e417-c857-497e-b2ee-46bff8afde85 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 1.987469 Sep 06 21:14:14.501556 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 37/71] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:12 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 1990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:14.513399 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b0363acb-8767-4fa5-bb56-408f9e4d2074 tempest-VolumesNegativeTest-1195248011 tempest-VolumesNegativeTest-1195248011-project] Action: 'create', calling method: .version_select at 0x7f04ce99c790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-127486157", "metadata": {"Type": "work"}}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:14:14.527075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b0363acb-8767-4fa5-bb56-408f9e4d2074 tempest-VolumesNegativeTest-1195248011 tempest-VolumesNegativeTest-1195248011-project] Request method failure captured: Sep 06 21:14:14.527075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 06 21:14:14.527075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:14:14.527075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:14:14.527075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:14:14.527075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 118 Sep 06 21:14:14.527075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:14:14.527075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:14:14.527075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:14:14.527075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:14:14.527075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7gkNv_NoilpXmyhqDd2AvbDX9omOLMVDVGbHK3a4yjamxEDN5rJp-QsD3jieFYx2sdfYvxduqqpaCBMKSEhq1jrvaHaa8FWAN-3FRCsvwQz5yblZ52oqy2uVN1rQPZ8V_8TfROIurwNX7bMnaWpRqcQk3EJfxcsAHxqSYfLjJJU_wE Sep 06 21:14:14.527075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:14:14.527075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:14:14.527075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:14:14.527075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:14:14.527075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:14:14.527075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:14:14.527075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: 4674191824504af487e97ada3bd6c17b Sep 06 21:14:14.527075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesNegativeTest-1195248011 Sep 06 21:14:14.527075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:14:14.527075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:14:14.528501 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4674191824504af487e97ada3bd6c17b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4674191824504af487e97ada3bd6c17b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4674191824504af487e97ada3bd6c17b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4674191824504af487e97ada3bd6c17b"}]}] Sep 06 21:14:14.528501 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-VolumesNegativeTest-1195248011 Sep 06 21:14:14.528501 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 4674191824504af487e97ada3bd6c17b Sep 06 21:14:14.528501 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesNegativeTest-1195248011 Sep 06 21:14:14.528501 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-VolumesNegativeTest-1195248011-project Sep 06 21:14:14.528501 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:14:14.528501 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:14:14.528501 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: b31347907161449b806aa08c49565869 Sep 06 21:14:14.528501 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-VolumesNegativeTest-1195248011-project Sep 06 21:14:14.528501 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Sep 06 21:14:14.528501 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-127486157", "metadata": {"Type": "work"}}} Sep 06 21:14:14.528501 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: Sep 06 21:14:14.528501 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 06 21:14:14.529360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-127486157', 'metadata': {'Type': 'work'}}}} Sep 06 21:14:14.529360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:14:14.529360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:14.529360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 21:14:14.529360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 21:14:14.529360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 21:14:14.529360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise error Sep 06 21:14:14.529360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 06 21:14:14.529360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.529360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 06 21:14:14.529360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 06 21:14:14.529360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.529360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 06 21:14:14.529360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi '' Sep 06 21:14:14.529360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.529360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:14:14.529360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.529360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:14.529360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:14:14.529360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:14:14.529360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:14:14.529360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:14:14.531833 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 21:14:14.531833 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 21:14:14.531833 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:14:14.531833 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:14:14.531833 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 21:14:14.531833 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 21:14:14.531833 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 21:14:14.531833 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 21:14:14.531833 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 21:14:14.531833 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 21:14:14.531833 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 06 21:14:14.531833 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.531833 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:14:14.531833 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.531833 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:14.531833 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:14:14.531833 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:14:14.531833 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 21:14:14.531833 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 21:14:14.534209 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 06 21:14:14.534209 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.534209 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b0363acb-8767-4fa5-bb56-408f9e4d2074 tempest-VolumesNegativeTest-1195248011 tempest-VolumesNegativeTest-1195248011-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:14:14.534209 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b0363acb-8767-4fa5-bb56-408f9e4d2074 tempest-VolumesNegativeTest-1195248011 tempest-VolumesNegativeTest-1195248011-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.028972 Sep 06 21:14:14.537261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 38/72] 10.222.0.79 () {60 vars in 1156 bytes} [Tue Sep 6 21:14:14 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 21:14:14.543295 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a881d72f-d95c-43e4-b91a-05fc36731d3b tempest-VolumesNegativeTest-1195248011 tempest-VolumesNegativeTest-1195248011-project] Calling method '.version_select at 0x7f04ce9320d0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:14.609341 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-a881d72f-d95c-43e4-b91a-05fc36731d3b tempest-VolumesNegativeTest-1195248011 tempest-VolumesNegativeTest-1195248011-project] HTTP exception thrown: Volume tempest-invalid-1723459540 could not be found. Sep 06 21:14:14.611708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a881d72f-d95c-43e4-b91a-05fc36731d3b tempest-VolumesNegativeTest-1195248011 tempest-VolumesNegativeTest-1195248011-project] Request method failure captured: Sep 06 21:14:14.611708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1723459540 HTTP/1.1 Sep 06 21:14:14.611708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:14:14.611708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:14:14.611708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:14:14.611708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:14:14.611708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:14:14.611708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:14:14.611708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:14:14.611708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:14:14.611708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7gkNv_NoilpXmyhqDd2AvbDX9omOLMVDVGbHK3a4yjamxEDN5rJp-QsD3jieFYx2sdfYvxduqqpaCBMKSEhq1jrvaHaa8FWAN-3FRCsvwQz5yblZ52oqy2uVN1rQPZ8V_8TfROIurwNX7bMnaWpRqcQk3EJfxcsAHxqSYfLjJJU_wE Sep 06 21:14:14.611708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:14:14.611708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:14:14.611708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:14:14.611708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:14:14.611708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:14:14.611708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:14:14.611708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: 4674191824504af487e97ada3bd6c17b Sep 06 21:14:14.611708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesNegativeTest-1195248011 Sep 06 21:14:14.611708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:14:14.611708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:14:14.613189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4674191824504af487e97ada3bd6c17b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4674191824504af487e97ada3bd6c17b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4674191824504af487e97ada3bd6c17b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4674191824504af487e97ada3bd6c17b"}]}] Sep 06 21:14:14.613189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-VolumesNegativeTest-1195248011 Sep 06 21:14:14.613189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 4674191824504af487e97ada3bd6c17b Sep 06 21:14:14.613189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesNegativeTest-1195248011 Sep 06 21:14:14.613189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-VolumesNegativeTest-1195248011-project Sep 06 21:14:14.613189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:14:14.613189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:14:14.613189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: b31347907161449b806aa08c49565869 Sep 06 21:14:14.613189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-VolumesNegativeTest-1195248011-project Sep 06 21:14:14.613189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: Sep 06 21:14:14.613189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Volume tempest-invalid-1723459540 could not be found. Sep 06 21:14:14.613189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'id': 'tempest-invalid-1723459540'} Sep 06 21:14:14.613189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:14:14.613857 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:14.613857 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 21:14:14.613857 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 21:14:14.613857 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 21:14:14.613857 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 21:14:14.613857 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 21:14:14.613857 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 21:14:14.613857 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 21:14:14.613857 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 21:14:14.613857 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 21:14:14.613857 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 21:14:14.613857 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 21:14:14.613857 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 21:14:14.613857 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 21:14:14.613857 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 21:14:14.613857 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1723459540 could not be found. (HTTP 404) (Request-ID: req-ffefb2e5-42d7-46ef-a6fe-1b5a5300ba91) Sep 06 21:14:14.613857 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.613857 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:14:14.613857 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.614874 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:14.614874 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 06 21:14:14.614874 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 06 21:14:14.614874 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 21:14:14.614874 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 21:14:14.614874 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 21:14:14.614874 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 21:14:14.614874 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 21:14:14.614874 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 21:14:14.614874 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 21:14:14.614874 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 21:14:14.614874 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 21:14:14.614874 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 21:14:14.614874 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 21:14:14.614874 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 21:14:14.614874 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 21:14:14.614874 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 21:14:14.614874 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 21:14:14.614874 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 21:14:14.615847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 21:14:14.615847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 21:14:14.615847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 21:14:14.615847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 21:14:14.615847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1723459540 could not be found. Sep 06 21:14:14.615847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.615847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:14:14.615847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.615847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:14.615847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:14:14.615847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:14:14.615847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:14:14.615847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:14:14.615847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 21:14:14.615847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 21:14:14.615847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:14:14.615847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:14:14.615847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 06 21:14:14.615847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:14:14.615847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1723459540 could not be found. Sep 06 21:14:14.617545 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.617545 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:14:14.617545 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.617545 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:14.617545 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:14:14.617545 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:14:14.617545 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:14:14.617545 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:14:14.617545 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1723459540 could not be found. Sep 06 21:14:14.617545 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.623662 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a881d72f-d95c-43e4-b91a-05fc36731d3b tempest-VolumesNegativeTest-1195248011 tempest-VolumesNegativeTest-1195248011-project] Returning 404 to user: Volume tempest-invalid-1723459540 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:14:14.624816 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a881d72f-d95c-43e4-b91a-05fc36731d3b tempest-VolumesNegativeTest-1195248011 tempest-VolumesNegativeTest-1195248011-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1723459540" status: 404 len: 99 microversion: 2.1 time: 0.086210 Sep 06 21:14:14.625575 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 39/73] 10.222.0.79 () {58 vars in 1218 bytes} [Tue Sep 6 21:14:14 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1723459540 => generated 99 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 21:14:14.640244 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a89e31e8-1bda-43c6-9faa-e343e15a1275 tempest-VolumesNegativeTest-1195248011 tempest-VolumesNegativeTest-1195248011-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008143 Sep 06 21:14:14.644106 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 40/74] 10.222.0.79 () {58 vars in 1140 bytes} [Tue Sep 6 21:14:14 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 06 21:14:14.657516 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8732569e-a553-4391-a2e9-30ccbf157d3c tempest-VolumesNegativeTest-1195248011 tempest-VolumesNegativeTest-1195248011-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007694 Sep 06 21:14:14.668817 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 41/75] 10.222.0.79 () {58 vars in 1137 bytes} [Tue Sep 6 21:14:14 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 06 21:14:14.679854 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4a285928-a26e-4025-b86d-05eaeae3c00d tempest-VolumesNegativeTest-1195248011 tempest-VolumesNegativeTest-1195248011-project] Calling method '.version_select at 0x7f04ceaa5160>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:14.762305 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-4a285928-a26e-4025-b86d-05eaeae3c00d tempest-VolumesNegativeTest-1195248011 tempest-VolumesNegativeTest-1195248011-project] HTTP exception thrown: Volume d6208d3b-7d4f-4678-9b1b-31f97bfc1085 could not be found. Sep 06 21:14:14.764947 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4a285928-a26e-4025-b86d-05eaeae3c00d tempest-VolumesNegativeTest-1195248011 tempest-VolumesNegativeTest-1195248011-project] Request method failure captured: Sep 06 21:14:14.764947 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: DELETE /compute/v2.1/os-volumes/d6208d3b-7d4f-4678-9b1b-31f97bfc1085 HTTP/1.1 Sep 06 21:14:14.764947 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:14:14.764947 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:14:14.764947 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:14:14.764947 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:14:14.764947 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:14:14.764947 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:14:14.764947 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:14:14.764947 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:14:14.764947 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7gkNv_NoilpXmyhqDd2AvbDX9omOLMVDVGbHK3a4yjamxEDN5rJp-QsD3jieFYx2sdfYvxduqqpaCBMKSEhq1jrvaHaa8FWAN-3FRCsvwQz5yblZ52oqy2uVN1rQPZ8V_8TfROIurwNX7bMnaWpRqcQk3EJfxcsAHxqSYfLjJJU_wE Sep 06 21:14:14.764947 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:14:14.764947 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:14:14.764947 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:14:14.764947 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:14:14.764947 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:14:14.764947 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:14:14.764947 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: 4674191824504af487e97ada3bd6c17b Sep 06 21:14:14.764947 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesNegativeTest-1195248011 Sep 06 21:14:14.764947 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:14:14.764947 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:14:14.766146 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4674191824504af487e97ada3bd6c17b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4674191824504af487e97ada3bd6c17b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4674191824504af487e97ada3bd6c17b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4674191824504af487e97ada3bd6c17b"}]}] Sep 06 21:14:14.766146 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-VolumesNegativeTest-1195248011 Sep 06 21:14:14.766146 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 4674191824504af487e97ada3bd6c17b Sep 06 21:14:14.766146 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesNegativeTest-1195248011 Sep 06 21:14:14.766146 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-VolumesNegativeTest-1195248011-project Sep 06 21:14:14.766146 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:14:14.766146 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:14:14.766146 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: b31347907161449b806aa08c49565869 Sep 06 21:14:14.766146 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-VolumesNegativeTest-1195248011-project Sep 06 21:14:14.766146 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: Sep 06 21:14:14.766146 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Volume d6208d3b-7d4f-4678-9b1b-31f97bfc1085 could not be found. Sep 06 21:14:14.766146 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'id': 'd6208d3b-7d4f-4678-9b1b-31f97bfc1085'} Sep 06 21:14:14.766146 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:14:14.766854 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:14.766854 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 21:14:14.766854 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 21:14:14.766854 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 21:14:14.766854 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 21:14:14.766854 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 21:14:14.766854 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 21:14:14.766854 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 21:14:14.766854 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 21:14:14.766854 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 21:14:14.766854 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 21:14:14.766854 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 21:14:14.766854 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 21:14:14.766854 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 21:14:14.766854 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 21:14:14.766854 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d6208d3b-7d4f-4678-9b1b-31f97bfc1085 could not be found. (HTTP 404) (Request-ID: req-0d4dfc82-504f-48bf-82e3-347cd7a3c1f7) Sep 06 21:14:14.766854 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.766854 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:14:14.766854 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.767908 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:14.767908 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 06 21:14:14.767908 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 06 21:14:14.767908 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 21:14:14.767908 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 21:14:14.767908 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 21:14:14.767908 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 21:14:14.767908 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 21:14:14.767908 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 21:14:14.767908 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 21:14:14.767908 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 21:14:14.767908 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 21:14:14.767908 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 21:14:14.767908 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 21:14:14.767908 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 21:14:14.767908 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 21:14:14.767908 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 21:14:14.767908 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 21:14:14.767908 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 21:14:14.769158 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 21:14:14.769158 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 21:14:14.769158 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 21:14:14.769158 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 21:14:14.769158 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d6208d3b-7d4f-4678-9b1b-31f97bfc1085 could not be found. Sep 06 21:14:14.769158 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.769158 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:14:14.769158 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.769158 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:14.769158 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:14:14.769158 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:14:14.769158 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:14:14.769158 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:14:14.769158 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 21:14:14.769158 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 21:14:14.769158 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:14:14.769158 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:14:14.769158 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 06 21:14:14.769158 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:14:14.770242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d6208d3b-7d4f-4678-9b1b-31f97bfc1085 could not be found. Sep 06 21:14:14.770242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.770242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:14:14.770242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.770242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:14.770242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:14:14.770242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:14:14.770242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:14:14.770242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:14:14.770242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d6208d3b-7d4f-4678-9b1b-31f97bfc1085 could not be found. Sep 06 21:14:14.770242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.771831 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4a285928-a26e-4025-b86d-05eaeae3c00d tempest-VolumesNegativeTest-1195248011 tempest-VolumesNegativeTest-1195248011-project] Returning 404 to user: Volume d6208d3b-7d4f-4678-9b1b-31f97bfc1085 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:14:14.772865 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4a285928-a26e-4025-b86d-05eaeae3c00d tempest-VolumesNegativeTest-1195248011 tempest-VolumesNegativeTest-1195248011-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/d6208d3b-7d4f-4678-9b1b-31f97bfc1085" status: 404 len: 109 microversion: 2.1 time: 0.102586 Sep 06 21:14:14.778655 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 42/76] 10.222.0.79 () {58 vars in 1248 bytes} [Tue Sep 6 21:14:14 2022] DELETE /compute/v2.1/os-volumes/d6208d3b-7d4f-4678-9b1b-31f97bfc1085 => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:14:14.790930 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d518b3bb-8f96-467a-af96-3a0d3843760d tempest-VolumesNegativeTest-1195248011 tempest-VolumesNegativeTest-1195248011-project] Calling method '.version_select at 0x7f04ceaa5790>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:14.842942 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-d518b3bb-8f96-467a-af96-3a0d3843760d tempest-VolumesNegativeTest-1195248011 tempest-VolumesNegativeTest-1195248011-project] HTTP exception thrown: Volume faa87ee3-34c5-4dbd-97e9-13a8141ed1df could not be found. Sep 06 21:14:14.845357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d518b3bb-8f96-467a-af96-3a0d3843760d tempest-VolumesNegativeTest-1195248011 tempest-VolumesNegativeTest-1195248011-project] Request method failure captured: Sep 06 21:14:14.845357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/os-volumes/faa87ee3-34c5-4dbd-97e9-13a8141ed1df HTTP/1.1 Sep 06 21:14:14.845357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:14:14.845357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:14:14.845357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:14:14.845357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:14:14.845357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:14:14.845357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:14:14.845357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:14:14.845357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:14:14.845357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7gkNv_NoilpXmyhqDd2AvbDX9omOLMVDVGbHK3a4yjamxEDN5rJp-QsD3jieFYx2sdfYvxduqqpaCBMKSEhq1jrvaHaa8FWAN-3FRCsvwQz5yblZ52oqy2uVN1rQPZ8V_8TfROIurwNX7bMnaWpRqcQk3EJfxcsAHxqSYfLjJJU_wE Sep 06 21:14:14.845357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:14:14.845357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:14:14.845357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:14:14.845357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:14:14.845357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:14:14.845357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:14:14.845357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: 4674191824504af487e97ada3bd6c17b Sep 06 21:14:14.845357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesNegativeTest-1195248011 Sep 06 21:14:14.845357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:14:14.845357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:14:14.846624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4674191824504af487e97ada3bd6c17b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4674191824504af487e97ada3bd6c17b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4674191824504af487e97ada3bd6c17b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4674191824504af487e97ada3bd6c17b"}]}] Sep 06 21:14:14.846624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-VolumesNegativeTest-1195248011 Sep 06 21:14:14.846624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 4674191824504af487e97ada3bd6c17b Sep 06 21:14:14.846624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesNegativeTest-1195248011 Sep 06 21:14:14.846624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-VolumesNegativeTest-1195248011-project Sep 06 21:14:14.846624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:14:14.846624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:14:14.846624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: b31347907161449b806aa08c49565869 Sep 06 21:14:14.846624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-VolumesNegativeTest-1195248011-project Sep 06 21:14:14.846624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: Sep 06 21:14:14.846624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Volume faa87ee3-34c5-4dbd-97e9-13a8141ed1df could not be found. Sep 06 21:14:14.846624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'id': 'faa87ee3-34c5-4dbd-97e9-13a8141ed1df'} Sep 06 21:14:14.846624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:14:14.847286 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:14.847286 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 21:14:14.847286 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 21:14:14.847286 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 21:14:14.847286 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 21:14:14.847286 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 21:14:14.847286 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 21:14:14.847286 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 21:14:14.847286 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 21:14:14.847286 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 21:14:14.847286 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 21:14:14.847286 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 21:14:14.847286 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 21:14:14.847286 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 21:14:14.847286 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 21:14:14.847286 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume faa87ee3-34c5-4dbd-97e9-13a8141ed1df could not be found. (HTTP 404) (Request-ID: req-71d5349d-997c-480f-8ea2-7751e41f259d) Sep 06 21:14:14.847286 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.847286 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:14:14.847286 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.848242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:14.848242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 21:14:14.848242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 21:14:14.848242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 21:14:14.848242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 21:14:14.848242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 21:14:14.848242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 21:14:14.848242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 21:14:14.848242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 21:14:14.848242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 21:14:14.848242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 21:14:14.848242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 21:14:14.848242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 21:14:14.848242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 21:14:14.848242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 21:14:14.848242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 21:14:14.848242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 21:14:14.848242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 21:14:14.848242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 21:14:14.849313 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 21:14:14.849313 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 21:14:14.849313 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 21:14:14.849313 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 21:14:14.849313 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume faa87ee3-34c5-4dbd-97e9-13a8141ed1df could not be found. Sep 06 21:14:14.849313 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.849313 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:14:14.849313 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.849313 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:14.849313 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:14:14.849313 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:14:14.849313 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:14:14.849313 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:14:14.849313 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 21:14:14.849313 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 21:14:14.849313 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:14:14.849313 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:14:14.849313 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 21:14:14.849313 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:14:14.850276 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume faa87ee3-34c5-4dbd-97e9-13a8141ed1df could not be found. Sep 06 21:14:14.850276 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.850276 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:14:14.850276 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.850276 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:14:14.850276 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:14:14.850276 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:14:14.850276 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:14:14.850276 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:14:14.850276 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume faa87ee3-34c5-4dbd-97e9-13a8141ed1df could not be found. Sep 06 21:14:14.850276 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:14:14.852687 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d518b3bb-8f96-467a-af96-3a0d3843760d tempest-VolumesNegativeTest-1195248011 tempest-VolumesNegativeTest-1195248011-project] Returning 404 to user: Volume faa87ee3-34c5-4dbd-97e9-13a8141ed1df could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:14:14.854216 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d518b3bb-8f96-467a-af96-3a0d3843760d tempest-VolumesNegativeTest-1195248011 tempest-VolumesNegativeTest-1195248011-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/faa87ee3-34c5-4dbd-97e9-13a8141ed1df" status: 404 len: 109 microversion: 2.1 time: 0.073699 Sep 06 21:14:14.855278 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 43/77] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Sep 6 21:14:14 2022] GET /compute/v2.1/os-volumes/faa87ee3-34c5-4dbd-97e9-13a8141ed1df => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:14:14.979200 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-58cef6d6-0e92-4f93-8ecb-9d7105a67c22 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:14.979819 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-58cef6d6-0e92-4f93-8ecb-9d7105a67c22 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:15.009606 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58cef6d6-0e92-4f93-8ecb-9d7105a67c22 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:15.015058 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58cef6d6-0e92-4f93-8ecb-9d7105a67c22 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:15.015527 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58cef6d6-0e92-4f93-8ecb-9d7105a67c22 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:15.019866 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58cef6d6-0e92-4f93-8ecb-9d7105a67c22 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:15.024347 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58cef6d6-0e92-4f93-8ecb-9d7105a67c22 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:15.026047 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58cef6d6-0e92-4f93-8ecb-9d7105a67c22 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:15.382228 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:15.394827 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1ffb5e78-4a46-43c6-baf3-bf4cce677a66 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:15.406334 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1ffb5e78-4a46-43c6-baf3-bf4cce677a66 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 1.102196 Sep 06 21:14:15.410436 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 35/78] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:14 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:15.420171 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-267b1257-0262-4917-bc66-e0101cfc4509 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:15.422393 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-267b1257-0262-4917-bc66-e0101cfc4509 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:15.460429 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=22 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:15.463315 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-267b1257-0262-4917-bc66-e0101cfc4509 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:15.464024 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-267b1257-0262-4917-bc66-e0101cfc4509 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:15.466455 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-267b1257-0262-4917-bc66-e0101cfc4509 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:15.467397 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-267b1257-0262-4917-bc66-e0101cfc4509 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:15.469201 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-267b1257-0262-4917-bc66-e0101cfc4509 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:15.469803 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-267b1257-0262-4917-bc66-e0101cfc4509 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:15.499391 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-58cef6d6-0e92-4f93-8ecb-9d7105a67c22 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:15.542103 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-58cef6d6-0e92-4f93-8ecb-9d7105a67c22 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1295 microversion: 2.1 time: 0.567057 Sep 06 21:14:15.564363 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 44/79] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:14 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1295 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:14:15.574840 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5759d2e6-e11b-4ef3-881a-70ad3c40f83e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:15.595725 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5759d2e6-e11b-4ef3-881a-70ad3c40f83e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:15.623562 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5759d2e6-e11b-4ef3-881a-70ad3c40f83e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:15.624914 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5759d2e6-e11b-4ef3-881a-70ad3c40f83e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:15.637359 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5759d2e6-e11b-4ef3-881a-70ad3c40f83e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:15.646222 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5759d2e6-e11b-4ef3-881a-70ad3c40f83e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:15.647057 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5759d2e6-e11b-4ef3-881a-70ad3c40f83e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:15.647594 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5759d2e6-e11b-4ef3-881a-70ad3c40f83e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:15.902522 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-267b1257-0262-4917-bc66-e0101cfc4509 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:15.912010 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-267b1257-0262-4917-bc66-e0101cfc4509 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1280 microversion: 2.1 time: 0.500232 Sep 06 21:14:15.912594 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 36/80] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:15 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1280 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:16.175826 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=22 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:16.223372 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5759d2e6-e11b-4ef3-881a-70ad3c40f83e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:16.239903 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5759d2e6-e11b-4ef3-881a-70ad3c40f83e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:16.242182 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5759d2e6-e11b-4ef3-881a-70ad3c40f83e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:16.243635 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5759d2e6-e11b-4ef3-881a-70ad3c40f83e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.674369 Sep 06 21:14:16.257797 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 45/81] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:15 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:16.433054 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-045335e7-3445-4c8e-94e0-2ab6dfb1acbc tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:16.433672 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-045335e7-3445-4c8e-94e0-2ab6dfb1acbc tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:16.444775 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-045335e7-3445-4c8e-94e0-2ab6dfb1acbc tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:16.446711 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-045335e7-3445-4c8e-94e0-2ab6dfb1acbc tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:16.447350 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-045335e7-3445-4c8e-94e0-2ab6dfb1acbc tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:16.451729 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-045335e7-3445-4c8e-94e0-2ab6dfb1acbc tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:16.452251 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-045335e7-3445-4c8e-94e0-2ab6dfb1acbc tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:16.452751 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-045335e7-3445-4c8e-94e0-2ab6dfb1acbc tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:16.573946 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0b7199d1-b20c-4a44-a45e-0539e0276263 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:16.574642 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0b7199d1-b20c-4a44-a45e-0539e0276263 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:16.618373 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b7199d1-b20c-4a44-a45e-0539e0276263 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:16.618373 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b7199d1-b20c-4a44-a45e-0539e0276263 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:16.618662 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b7199d1-b20c-4a44-a45e-0539e0276263 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:16.619435 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b7199d1-b20c-4a44-a45e-0539e0276263 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:16.626002 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b7199d1-b20c-4a44-a45e-0539e0276263 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:16.626460 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b7199d1-b20c-4a44-a45e-0539e0276263 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:16.970803 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0b7199d1-b20c-4a44-a45e-0539e0276263 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:16.985142 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0b7199d1-b20c-4a44-a45e-0539e0276263 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1295 microversion: 2.1 time: 0.412859 Sep 06 21:14:16.986123 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 46/82] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:16 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1295 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:17.000953 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e24a9356-67c4-4f57-830e-9b0ca7b6f185 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:17.001629 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e24a9356-67c4-4f57-830e-9b0ca7b6f185 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:17.022712 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e24a9356-67c4-4f57-830e-9b0ca7b6f185 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:17.023242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e24a9356-67c4-4f57-830e-9b0ca7b6f185 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:17.023681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e24a9356-67c4-4f57-830e-9b0ca7b6f185 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:17.024428 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e24a9356-67c4-4f57-830e-9b0ca7b6f185 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:17.024975 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e24a9356-67c4-4f57-830e-9b0ca7b6f185 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:17.025303 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e24a9356-67c4-4f57-830e-9b0ca7b6f185 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:17.232958 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-045335e7-3445-4c8e-94e0-2ab6dfb1acbc tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:17.249113 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-045335e7-3445-4c8e-94e0-2ab6dfb1acbc tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.813851 Sep 06 21:14:17.264817 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 37/83] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:16 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:17.272755 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-185953d8-d683-4265-8ce9-c7b6d46590e9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:17.274266 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-185953d8-d683-4265-8ce9-c7b6d46590e9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:17.281888 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-185953d8-d683-4265-8ce9-c7b6d46590e9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:17.282709 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-185953d8-d683-4265-8ce9-c7b6d46590e9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:17.283227 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-185953d8-d683-4265-8ce9-c7b6d46590e9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:17.284323 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-185953d8-d683-4265-8ce9-c7b6d46590e9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:17.284999 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-185953d8-d683-4265-8ce9-c7b6d46590e9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:17.285613 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-185953d8-d683-4265-8ce9-c7b6d46590e9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:17.543741 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-185953d8-d683-4265-8ce9-c7b6d46590e9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:17.553829 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-185953d8-d683-4265-8ce9-c7b6d46590e9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:17.555752 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-185953d8-d683-4265-8ce9-c7b6d46590e9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:17.557082 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-185953d8-d683-4265-8ce9-c7b6d46590e9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.289244 Sep 06 21:14:17.572513 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 38/84] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:17 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:17.640725 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-50a0f985-5d94-4ed5-bc2c-fca7a922905d req-ed133221-07d5-4c24-9ea0-9888b29238ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689", "tag": "0cb98390-2901-4269-98b8-c6584aa71d54"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:14:17.662510 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-50a0f985-5d94-4ed5-bc2c-fca7a922905d req-ed133221-07d5-4c24-9ea0-9888b29238ec service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:17.662987 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-50a0f985-5d94-4ed5-bc2c-fca7a922905d req-ed133221-07d5-4c24-9ea0-9888b29238ec service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:17.663434 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-50a0f985-5d94-4ed5-bc2c-fca7a922905d req-ed133221-07d5-4c24-9ea0-9888b29238ec service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:17.685141 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-50a0f985-5d94-4ed5-bc2c-fca7a922905d req-ed133221-07d5-4c24-9ea0-9888b29238ec service nova] Creating event network-changed:0cb98390-2901-4269-98b8-c6584aa71d54 for instance ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 on hv-cinder-74915 Sep 06 21:14:17.685686 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-50a0f985-5d94-4ed5-bc2c-fca7a922905d req-ed133221-07d5-4c24-9ea0-9888b29238ec service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 06 21:14:17.686052 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-50a0f985-5d94-4ed5-bc2c-fca7a922905d req-ed133221-07d5-4c24-9ea0-9888b29238ec service nova] Acquired lock "compute-rpcapi-router" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 06 21:14:17.693311 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac7c882c-0b81-4b54-b230-4fe4feb44717 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:17.693787 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac7c882c-0b81-4b54-b230-4fe4feb44717 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:17.694375 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac7c882c-0b81-4b54-b230-4fe4feb44717 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:17.695273 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac7c882c-0b81-4b54-b230-4fe4feb44717 None None] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:17.695997 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac7c882c-0b81-4b54-b230-4fe4feb44717 None None] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:17.696563 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac7c882c-0b81-4b54-b230-4fe4feb44717 None None] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:17.711211 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.compute.rpcapi [None req-ac7c882c-0b81-4b54-b230-4fe4feb44717 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 06 21:14:17.712121 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac7c882c-0b81-4b54-b230-4fe4feb44717 None None] Releasing lock "compute-rpcapi-router" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 06 21:14:17.730071 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ac7c882c-0b81-4b54-b230-4fe4feb44717 None None] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155890 Sep 06 21:14:17.730615 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 39/85] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:14:17.764413 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e24a9356-67c4-4f57-830e-9b0ca7b6f185 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:17.768860 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:17.773937 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e24a9356-67c4-4f57-830e-9b0ca7b6f185 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.786778 Sep 06 21:14:17.780367 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 47/86] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:16 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:17.838015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-22b6d389-637b-4eda-bc11-63db7aafbfda req-c1d27da2-a543-4630-8f80-f650e37d7d5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4f062bd-6aa2-4c00-86a3-7ddc003c1713", "tag": "5502eac9-cbbf-4d67-87b5-f4110ae65ddf"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:14:17.858207 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-22b6d389-637b-4eda-bc11-63db7aafbfda req-c1d27da2-a543-4630-8f80-f650e37d7d5b service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:17.859233 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-22b6d389-637b-4eda-bc11-63db7aafbfda req-c1d27da2-a543-4630-8f80-f650e37d7d5b service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:17.861869 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-22b6d389-637b-4eda-bc11-63db7aafbfda req-c1d27da2-a543-4630-8f80-f650e37d7d5b service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:17.881077 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-22b6d389-637b-4eda-bc11-63db7aafbfda req-c1d27da2-a543-4630-8f80-f650e37d7d5b service nova] Creating event network-changed:5502eac9-cbbf-4d67-87b5-f4110ae65ddf for instance e4f062bd-6aa2-4c00-86a3-7ddc003c1713 on hv-cinder-74915 Sep 06 21:14:17.913637 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-22b6d389-637b-4eda-bc11-63db7aafbfda req-c1d27da2-a543-4630-8f80-f650e37d7d5b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179728 Sep 06 21:14:17.916301 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 40/87] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:14:18.008287 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1f7af04e-13e7-4ea2-b9cc-d883555bd1d5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:18.008906 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1f7af04e-13e7-4ea2-b9cc-d883555bd1d5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:18.017592 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f7af04e-13e7-4ea2-b9cc-d883555bd1d5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:18.019424 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f7af04e-13e7-4ea2-b9cc-d883555bd1d5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:18.019863 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f7af04e-13e7-4ea2-b9cc-d883555bd1d5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:18.020573 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f7af04e-13e7-4ea2-b9cc-d883555bd1d5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:18.021347 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f7af04e-13e7-4ea2-b9cc-d883555bd1d5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:18.022677 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f7af04e-13e7-4ea2-b9cc-d883555bd1d5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:18.194182 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1f7af04e-13e7-4ea2-b9cc-d883555bd1d5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:18.203703 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1f7af04e-13e7-4ea2-b9cc-d883555bd1d5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.199804 Sep 06 21:14:18.204441 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 48/88] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:18 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:18.275288 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-90d25cf8-d756-46f8-b8a0-de14e28d3921 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:18.276081 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-90d25cf8-d756-46f8-b8a0-de14e28d3921 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:18.284554 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90d25cf8-d756-46f8-b8a0-de14e28d3921 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:18.285010 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90d25cf8-d756-46f8-b8a0-de14e28d3921 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:18.285737 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90d25cf8-d756-46f8-b8a0-de14e28d3921 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:18.286381 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90d25cf8-d756-46f8-b8a0-de14e28d3921 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:18.287043 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90d25cf8-d756-46f8-b8a0-de14e28d3921 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:18.287347 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90d25cf8-d756-46f8-b8a0-de14e28d3921 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:18.312353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:18.484974 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-90d25cf8-d756-46f8-b8a0-de14e28d3921 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:18.494714 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-90d25cf8-d756-46f8-b8a0-de14e28d3921 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.224784 Sep 06 21:14:18.509487 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 41/89] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:18 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:18.590758 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-340db4e9-9187-4389-bf84-14b0b98accd6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:18.591977 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-340db4e9-9187-4389-bf84-14b0b98accd6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:18.600366 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-340db4e9-9187-4389-bf84-14b0b98accd6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:18.601855 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-340db4e9-9187-4389-bf84-14b0b98accd6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:18.602313 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-340db4e9-9187-4389-bf84-14b0b98accd6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:18.603409 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-340db4e9-9187-4389-bf84-14b0b98accd6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:18.603963 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-340db4e9-9187-4389-bf84-14b0b98accd6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:18.604813 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-340db4e9-9187-4389-bf84-14b0b98accd6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:18.770206 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-340db4e9-9187-4389-bf84-14b0b98accd6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:18.778568 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-340db4e9-9187-4389-bf84-14b0b98accd6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:18.780088 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-340db4e9-9187-4389-bf84-14b0b98accd6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:18.781222 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-340db4e9-9187-4389-bf84-14b0b98accd6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.197897 Sep 06 21:14:18.781926 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 49/90] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:18 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:18.811923 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-17af687c-b9e5-4773-a981-23a3e67f2d34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:18.812729 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-17af687c-b9e5-4773-a981-23a3e67f2d34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:18.819066 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17af687c-b9e5-4773-a981-23a3e67f2d34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:18.819538 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17af687c-b9e5-4773-a981-23a3e67f2d34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:18.820171 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17af687c-b9e5-4773-a981-23a3e67f2d34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:18.820905 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17af687c-b9e5-4773-a981-23a3e67f2d34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:18.821352 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17af687c-b9e5-4773-a981-23a3e67f2d34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:18.821763 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17af687c-b9e5-4773-a981-23a3e67f2d34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:18.970561 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-17af687c-b9e5-4773-a981-23a3e67f2d34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:18.979342 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-17af687c-b9e5-4773-a981-23a3e67f2d34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.171201 Sep 06 21:14:18.980276 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 42/91] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:18 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:19.226978 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c32c914b-f025-4297-bcd1-a34a4c37ac3a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:19.227741 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c32c914b-f025-4297-bcd1-a34a4c37ac3a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:19.234292 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c32c914b-f025-4297-bcd1-a34a4c37ac3a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:19.234703 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c32c914b-f025-4297-bcd1-a34a4c37ac3a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:19.235136 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c32c914b-f025-4297-bcd1-a34a4c37ac3a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:19.235831 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c32c914b-f025-4297-bcd1-a34a4c37ac3a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:19.236283 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c32c914b-f025-4297-bcd1-a34a4c37ac3a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:19.236731 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c32c914b-f025-4297-bcd1-a34a4c37ac3a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:19.379978 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c32c914b-f025-4297-bcd1-a34a4c37ac3a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:19.390095 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c32c914b-f025-4297-bcd1-a34a4c37ac3a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.167120 Sep 06 21:14:19.390978 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 50/92] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:19 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:19.519870 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-14298f23-4272-42cc-8aff-f94ee9cfe40c tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:19.520598 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-14298f23-4272-42cc-8aff-f94ee9cfe40c tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:19.527274 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14298f23-4272-42cc-8aff-f94ee9cfe40c tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:19.527861 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14298f23-4272-42cc-8aff-f94ee9cfe40c tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:19.528590 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14298f23-4272-42cc-8aff-f94ee9cfe40c tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:19.529545 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14298f23-4272-42cc-8aff-f94ee9cfe40c tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:19.530060 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14298f23-4272-42cc-8aff-f94ee9cfe40c tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:19.530680 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14298f23-4272-42cc-8aff-f94ee9cfe40c tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:19.683263 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-14298f23-4272-42cc-8aff-f94ee9cfe40c tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:19.693508 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-14298f23-4272-42cc-8aff-f94ee9cfe40c tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.177830 Sep 06 21:14:19.694297 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 43/93] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:19 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:19.762287 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-501101d8-8505-4cc4-9532-7bd1a69f9833 req-3553abc8-12ea-4e43-abc6-bbe7757b0493 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fea1aa0-032e-454d-9358-98a81cd5d650", "tag": "7ea4447f-6e97-421a-ae16-09790d6651e8"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:14:19.773934 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:19.780189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-501101d8-8505-4cc4-9532-7bd1a69f9833 req-3553abc8-12ea-4e43-abc6-bbe7757b0493 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:19.780809 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-501101d8-8505-4cc4-9532-7bd1a69f9833 req-3553abc8-12ea-4e43-abc6-bbe7757b0493 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:19.781407 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-501101d8-8505-4cc4-9532-7bd1a69f9833 req-3553abc8-12ea-4e43-abc6-bbe7757b0493 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:19.803146 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-501101d8-8505-4cc4-9532-7bd1a69f9833 req-3553abc8-12ea-4e43-abc6-bbe7757b0493 service nova] Creating event network-changed:7ea4447f-6e97-421a-ae16-09790d6651e8 for instance 8fea1aa0-032e-454d-9358-98a81cd5d650 on hv-cinder-74915 Sep 06 21:14:19.803673 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-501101d8-8505-4cc4-9532-7bd1a69f9833 req-3553abc8-12ea-4e43-abc6-bbe7757b0493 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120719) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 06 21:14:19.804086 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-501101d8-8505-4cc4-9532-7bd1a69f9833 req-3553abc8-12ea-4e43-abc6-bbe7757b0493 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120719) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 06 21:14:19.805246 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e157df2-97ad-4a79-b42a-0e237695e0f2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:19.805686 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e157df2-97ad-4a79-b42a-0e237695e0f2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:19.806302 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-168bfde1-2678-4adf-b7ca-4dace8cd7cfe tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:19.806419 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e157df2-97ad-4a79-b42a-0e237695e0f2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:19.807038 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e157df2-97ad-4a79-b42a-0e237695e0f2 None None] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:19.807414 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-168bfde1-2678-4adf-b7ca-4dace8cd7cfe tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:19.807516 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e157df2-97ad-4a79-b42a-0e237695e0f2 None None] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:19.807867 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e157df2-97ad-4a79-b42a-0e237695e0f2 None None] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:19.811318 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:19.816252 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-168bfde1-2678-4adf-b7ca-4dace8cd7cfe tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:19.817589 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-168bfde1-2678-4adf-b7ca-4dace8cd7cfe tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:19.818217 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-168bfde1-2678-4adf-b7ca-4dace8cd7cfe tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:19.818348 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.compute.rpcapi [None req-8e157df2-97ad-4a79-b42a-0e237695e0f2 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 06 21:14:19.819242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e157df2-97ad-4a79-b42a-0e237695e0f2 None None] Releasing lock "compute-rpcapi-router" {{(pid=120719) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 06 21:14:19.819363 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-168bfde1-2678-4adf-b7ca-4dace8cd7cfe tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:19.820013 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-168bfde1-2678-4adf-b7ca-4dace8cd7cfe tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:19.820638 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-168bfde1-2678-4adf-b7ca-4dace8cd7cfe tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:19.836478 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8e157df2-97ad-4a79-b42a-0e237695e0f2 None None] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078555 Sep 06 21:14:19.837437 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 51/94] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:14:19.964491 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-168bfde1-2678-4adf-b7ca-4dace8cd7cfe tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:19.974870 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-168bfde1-2678-4adf-b7ca-4dace8cd7cfe tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:19.976511 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-168bfde1-2678-4adf-b7ca-4dace8cd7cfe tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:19.978159 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-168bfde1-2678-4adf-b7ca-4dace8cd7cfe tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.176161 Sep 06 21:14:19.978707 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 44/95] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:19 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 21:14:20.012725 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a2e6d7d2-8461-4162-aedc-7673e0301059 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:20.013530 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a2e6d7d2-8461-4162-aedc-7673e0301059 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:20.020126 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2e6d7d2-8461-4162-aedc-7673e0301059 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:20.020614 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2e6d7d2-8461-4162-aedc-7673e0301059 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:20.021073 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2e6d7d2-8461-4162-aedc-7673e0301059 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:20.021975 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2e6d7d2-8461-4162-aedc-7673e0301059 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:20.022632 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2e6d7d2-8461-4162-aedc-7673e0301059 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:20.023443 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2e6d7d2-8461-4162-aedc-7673e0301059 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:20.167998 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a2e6d7d2-8461-4162-aedc-7673e0301059 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:20.176809 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a2e6d7d2-8461-4162-aedc-7673e0301059 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.177483 Sep 06 21:14:20.177517 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 52/96] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:19 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:20.413675 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0f18e2fc-3a06-4fdc-986e-34cbc105ad76 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:20.414298 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0f18e2fc-3a06-4fdc-986e-34cbc105ad76 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:20.420317 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f18e2fc-3a06-4fdc-986e-34cbc105ad76 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:20.420818 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f18e2fc-3a06-4fdc-986e-34cbc105ad76 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:20.421245 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f18e2fc-3a06-4fdc-986e-34cbc105ad76 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:20.421967 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f18e2fc-3a06-4fdc-986e-34cbc105ad76 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:20.422403 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f18e2fc-3a06-4fdc-986e-34cbc105ad76 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:20.422810 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f18e2fc-3a06-4fdc-986e-34cbc105ad76 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:20.576232 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0f18e2fc-3a06-4fdc-986e-34cbc105ad76 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:20.584535 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0f18e2fc-3a06-4fdc-986e-34cbc105ad76 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.174694 Sep 06 21:14:20.585149 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 45/97] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:20 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:20.717475 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7e47f74b-b6e2-4f80-8a55-c3af1db62396 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:20.718089 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7e47f74b-b6e2-4f80-8a55-c3af1db62396 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:20.724388 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e47f74b-b6e2-4f80-8a55-c3af1db62396 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:20.725193 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e47f74b-b6e2-4f80-8a55-c3af1db62396 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:20.725788 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e47f74b-b6e2-4f80-8a55-c3af1db62396 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:20.726678 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e47f74b-b6e2-4f80-8a55-c3af1db62396 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:20.727273 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e47f74b-b6e2-4f80-8a55-c3af1db62396 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:20.727844 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e47f74b-b6e2-4f80-8a55-c3af1db62396 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:20.913424 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7e47f74b-b6e2-4f80-8a55-c3af1db62396 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:20.922426 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7e47f74b-b6e2-4f80-8a55-c3af1db62396 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.208665 Sep 06 21:14:20.937443 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 53/98] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:20 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:21.005447 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b7a514fc-b7b0-4fa4-aa25-6747e2cbc78d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:21.006120 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b7a514fc-b7b0-4fa4-aa25-6747e2cbc78d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:21.017931 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7a514fc-b7b0-4fa4-aa25-6747e2cbc78d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:21.018447 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7a514fc-b7b0-4fa4-aa25-6747e2cbc78d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:21.019032 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7a514fc-b7b0-4fa4-aa25-6747e2cbc78d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:21.019867 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7a514fc-b7b0-4fa4-aa25-6747e2cbc78d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:21.021198 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7a514fc-b7b0-4fa4-aa25-6747e2cbc78d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:21.021788 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7a514fc-b7b0-4fa4-aa25-6747e2cbc78d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:21.202291 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e5066215-c863-4a61-9803-da6075f7b28c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:21.203160 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e5066215-c863-4a61-9803-da6075f7b28c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:21.214969 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5066215-c863-4a61-9803-da6075f7b28c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:21.217350 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5066215-c863-4a61-9803-da6075f7b28c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:21.220393 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5066215-c863-4a61-9803-da6075f7b28c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:21.221598 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5066215-c863-4a61-9803-da6075f7b28c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:21.222325 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5066215-c863-4a61-9803-da6075f7b28c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:21.223635 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5066215-c863-4a61-9803-da6075f7b28c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:21.232099 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b7a514fc-b7b0-4fa4-aa25-6747e2cbc78d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:21.240689 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b7a514fc-b7b0-4fa4-aa25-6747e2cbc78d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:21.247919 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b7a514fc-b7b0-4fa4-aa25-6747e2cbc78d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:21.252151 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b7a514fc-b7b0-4fa4-aa25-6747e2cbc78d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.250905 Sep 06 21:14:21.253880 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 46/99] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:20 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:21.431411 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e5066215-c863-4a61-9803-da6075f7b28c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:21.445092 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e5066215-c863-4a61-9803-da6075f7b28c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.241594 Sep 06 21:14:21.452489 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 54/100] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:21 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:21.611730 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1d14ec68-e230-41e4-8969-0907badf280e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:21.612325 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1d14ec68-e230-41e4-8969-0907badf280e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:21.634393 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d14ec68-e230-41e4-8969-0907badf280e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:21.634877 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d14ec68-e230-41e4-8969-0907badf280e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:21.635319 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d14ec68-e230-41e4-8969-0907badf280e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:21.638385 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d14ec68-e230-41e4-8969-0907badf280e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:21.638870 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d14ec68-e230-41e4-8969-0907badf280e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:21.641652 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d14ec68-e230-41e4-8969-0907badf280e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:21.884173 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1d14ec68-e230-41e4-8969-0907badf280e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:21.892704 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1d14ec68-e230-41e4-8969-0907badf280e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.285007 Sep 06 21:14:21.909295 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 47/101] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:21 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:21.948289 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-15f1ba04-666f-4724-b13e-15c086a0b95d tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:21.958880 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-15f1ba04-666f-4724-b13e-15c086a0b95d tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:21.967891 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15f1ba04-666f-4724-b13e-15c086a0b95d tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:21.968772 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15f1ba04-666f-4724-b13e-15c086a0b95d tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:21.969380 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15f1ba04-666f-4724-b13e-15c086a0b95d tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:21.970353 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15f1ba04-666f-4724-b13e-15c086a0b95d tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:21.971022 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15f1ba04-666f-4724-b13e-15c086a0b95d tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:21.971766 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15f1ba04-666f-4724-b13e-15c086a0b95d tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:22.164461 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-15f1ba04-666f-4724-b13e-15c086a0b95d tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:22.172414 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-15f1ba04-666f-4724-b13e-15c086a0b95d tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.229129 Sep 06 21:14:22.173000 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 55/102] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:21 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:22.278042 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-851561ae-d1a7-4db9-8fec-371f510144f0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:22.278647 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-851561ae-d1a7-4db9-8fec-371f510144f0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:22.284971 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-851561ae-d1a7-4db9-8fec-371f510144f0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:22.285279 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-851561ae-d1a7-4db9-8fec-371f510144f0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:22.285701 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-851561ae-d1a7-4db9-8fec-371f510144f0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:22.286385 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-851561ae-d1a7-4db9-8fec-371f510144f0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:22.286820 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-851561ae-d1a7-4db9-8fec-371f510144f0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:22.287233 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-851561ae-d1a7-4db9-8fec-371f510144f0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:22.432170 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-851561ae-d1a7-4db9-8fec-371f510144f0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:22.441766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-851561ae-d1a7-4db9-8fec-371f510144f0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:22.443217 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-851561ae-d1a7-4db9-8fec-371f510144f0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:22.444339 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-851561ae-d1a7-4db9-8fec-371f510144f0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.170281 Sep 06 21:14:22.444899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 48/103] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:22 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:22.468471 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-051fd52c-5097-444e-80ce-37e238353c48 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:22.469126 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-051fd52c-5097-444e-80ce-37e238353c48 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:22.476522 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-051fd52c-5097-444e-80ce-37e238353c48 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:22.477170 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-051fd52c-5097-444e-80ce-37e238353c48 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:22.477601 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-051fd52c-5097-444e-80ce-37e238353c48 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:22.478298 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-051fd52c-5097-444e-80ce-37e238353c48 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:22.478774 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-051fd52c-5097-444e-80ce-37e238353c48 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:22.479195 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-051fd52c-5097-444e-80ce-37e238353c48 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:22.622254 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-051fd52c-5097-444e-80ce-37e238353c48 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:22.630574 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-051fd52c-5097-444e-80ce-37e238353c48 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.166265 Sep 06 21:14:22.631354 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 56/104] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:22 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:22.919931 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-17f19bc3-6110-48fe-a281-509cea4be984 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:22.920602 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-17f19bc3-6110-48fe-a281-509cea4be984 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:22.927567 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17f19bc3-6110-48fe-a281-509cea4be984 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:22.928050 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17f19bc3-6110-48fe-a281-509cea4be984 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:22.928481 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17f19bc3-6110-48fe-a281-509cea4be984 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:22.929222 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17f19bc3-6110-48fe-a281-509cea4be984 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:22.929677 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17f19bc3-6110-48fe-a281-509cea4be984 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:22.930111 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17f19bc3-6110-48fe-a281-509cea4be984 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:23.073516 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-17f19bc3-6110-48fe-a281-509cea4be984 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:23.082138 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-17f19bc3-6110-48fe-a281-509cea4be984 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.166256 Sep 06 21:14:23.092683 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 49/105] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:22 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:23.196441 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0d47364e-85e1-4687-9157-36f959ff98a5 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:23.197184 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0d47364e-85e1-4687-9157-36f959ff98a5 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:23.204226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d47364e-85e1-4687-9157-36f959ff98a5 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:23.204951 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d47364e-85e1-4687-9157-36f959ff98a5 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:23.205836 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d47364e-85e1-4687-9157-36f959ff98a5 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:23.206535 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d47364e-85e1-4687-9157-36f959ff98a5 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:23.206983 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d47364e-85e1-4687-9157-36f959ff98a5 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:23.207402 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d47364e-85e1-4687-9157-36f959ff98a5 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:23.343001 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0d47364e-85e1-4687-9157-36f959ff98a5 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:23.353210 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0d47364e-85e1-4687-9157-36f959ff98a5 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.161232 Sep 06 21:14:23.367483 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 57/106] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:23 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:23.469717 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-44a5df62-3ece-40dd-a3fd-1192d8cf5295 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:23.471084 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-44a5df62-3ece-40dd-a3fd-1192d8cf5295 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:23.478386 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44a5df62-3ece-40dd-a3fd-1192d8cf5295 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:23.479129 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44a5df62-3ece-40dd-a3fd-1192d8cf5295 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:23.479553 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44a5df62-3ece-40dd-a3fd-1192d8cf5295 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:23.480318 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44a5df62-3ece-40dd-a3fd-1192d8cf5295 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:23.480750 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44a5df62-3ece-40dd-a3fd-1192d8cf5295 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:23.481157 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44a5df62-3ece-40dd-a3fd-1192d8cf5295 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:23.632453 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-44a5df62-3ece-40dd-a3fd-1192d8cf5295 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:23.640831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-44a5df62-3ece-40dd-a3fd-1192d8cf5295 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:23.642250 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-44a5df62-3ece-40dd-a3fd-1192d8cf5295 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:23.643405 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-44a5df62-3ece-40dd-a3fd-1192d8cf5295 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.177785 Sep 06 21:14:23.643950 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 50/107] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:23 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:23.653564 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-39c345d9-ac15-423f-bc85-714fef301155 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:23.654389 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-39c345d9-ac15-423f-bc85-714fef301155 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:23.660847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39c345d9-ac15-423f-bc85-714fef301155 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:23.661413 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39c345d9-ac15-423f-bc85-714fef301155 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:23.661841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39c345d9-ac15-423f-bc85-714fef301155 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:23.662549 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39c345d9-ac15-423f-bc85-714fef301155 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:23.663010 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39c345d9-ac15-423f-bc85-714fef301155 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:23.663456 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39c345d9-ac15-423f-bc85-714fef301155 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:23.806606 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-39c345d9-ac15-423f-bc85-714fef301155 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:23.820312 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-39c345d9-ac15-423f-bc85-714fef301155 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.169130 Sep 06 21:14:23.826472 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 58/108] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:23 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:24.105390 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-775c28ca-9327-4d89-bd9a-46b0bdb74b8a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:24.105993 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-775c28ca-9327-4d89-bd9a-46b0bdb74b8a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:24.112752 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-775c28ca-9327-4d89-bd9a-46b0bdb74b8a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:24.113523 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-775c28ca-9327-4d89-bd9a-46b0bdb74b8a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:24.113642 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-775c28ca-9327-4d89-bd9a-46b0bdb74b8a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:24.114274 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-775c28ca-9327-4d89-bd9a-46b0bdb74b8a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:24.114711 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-775c28ca-9327-4d89-bd9a-46b0bdb74b8a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:24.115122 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-775c28ca-9327-4d89-bd9a-46b0bdb74b8a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:24.245718 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-775c28ca-9327-4d89-bd9a-46b0bdb74b8a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:24.254120 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-775c28ca-9327-4d89-bd9a-46b0bdb74b8a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.152728 Sep 06 21:14:24.254720 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 51/109] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:24 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:24.378414 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e0ce66be-7d1e-4314-ba32-af5d91d9eb7a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:24.378999 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e0ce66be-7d1e-4314-ba32-af5d91d9eb7a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:24.385922 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0ce66be-7d1e-4314-ba32-af5d91d9eb7a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:24.386399 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0ce66be-7d1e-4314-ba32-af5d91d9eb7a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:24.386831 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0ce66be-7d1e-4314-ba32-af5d91d9eb7a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:24.387519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0ce66be-7d1e-4314-ba32-af5d91d9eb7a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:24.387967 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0ce66be-7d1e-4314-ba32-af5d91d9eb7a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:24.388393 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0ce66be-7d1e-4314-ba32-af5d91d9eb7a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:24.526949 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e0ce66be-7d1e-4314-ba32-af5d91d9eb7a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:24.535422 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e0ce66be-7d1e-4314-ba32-af5d91d9eb7a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.162450 Sep 06 21:14:24.536008 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 59/110] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:24 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:24.672591 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-55d317b0-cef6-4493-881c-bb7a1aae3ea3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:24.675433 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-55d317b0-cef6-4493-881c-bb7a1aae3ea3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:24.685925 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55d317b0-cef6-4493-881c-bb7a1aae3ea3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:24.686768 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55d317b0-cef6-4493-881c-bb7a1aae3ea3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:24.687468 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55d317b0-cef6-4493-881c-bb7a1aae3ea3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:24.688604 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55d317b0-cef6-4493-881c-bb7a1aae3ea3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:24.689378 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55d317b0-cef6-4493-881c-bb7a1aae3ea3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:24.690228 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55d317b0-cef6-4493-881c-bb7a1aae3ea3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:24.847551 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b76ac4f7-912e-4d14-b6c9-7735d2919476 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:24.847772 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b76ac4f7-912e-4d14-b6c9-7735d2919476 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:24.849720 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-55d317b0-cef6-4493-881c-bb7a1aae3ea3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:24.861912 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-55d317b0-cef6-4493-881c-bb7a1aae3ea3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:24.862273 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b76ac4f7-912e-4d14-b6c9-7735d2919476 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:24.862941 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b76ac4f7-912e-4d14-b6c9-7735d2919476 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:24.863537 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b76ac4f7-912e-4d14-b6c9-7735d2919476 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:24.864049 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-55d317b0-cef6-4493-881c-bb7a1aae3ea3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:24.864585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b76ac4f7-912e-4d14-b6c9-7735d2919476 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:24.865051 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b76ac4f7-912e-4d14-b6c9-7735d2919476 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:24.865500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-55d317b0-cef6-4493-881c-bb7a1aae3ea3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.199327 Sep 06 21:14:24.865671 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b76ac4f7-912e-4d14-b6c9-7735d2919476 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:24.866633 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 52/111] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:24 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:25.011740 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b76ac4f7-912e-4d14-b6c9-7735d2919476 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:25.020517 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b76ac4f7-912e-4d14-b6c9-7735d2919476 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.178781 Sep 06 21:14:25.021352 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 60/112] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:24 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:25.282143 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2c1b86ba-6093-49ae-bf12-5dfca1a41398 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:25.283144 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2c1b86ba-6093-49ae-bf12-5dfca1a41398 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:25.293358 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c1b86ba-6093-49ae-bf12-5dfca1a41398 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:25.294469 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c1b86ba-6093-49ae-bf12-5dfca1a41398 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:25.295357 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c1b86ba-6093-49ae-bf12-5dfca1a41398 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:25.296719 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c1b86ba-6093-49ae-bf12-5dfca1a41398 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:25.297643 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c1b86ba-6093-49ae-bf12-5dfca1a41398 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:25.298517 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c1b86ba-6093-49ae-bf12-5dfca1a41398 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:25.440148 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2c1b86ba-6093-49ae-bf12-5dfca1a41398 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:25.449106 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2c1b86ba-6093-49ae-bf12-5dfca1a41398 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.175010 Sep 06 21:14:25.460035 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 53/113] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:25 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:25.561621 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-57fb66ac-d3d7-4fce-90b6-eed190fa9a3b tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:25.562233 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-57fb66ac-d3d7-4fce-90b6-eed190fa9a3b tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:25.570001 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-57fb66ac-d3d7-4fce-90b6-eed190fa9a3b tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:25.570475 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-57fb66ac-d3d7-4fce-90b6-eed190fa9a3b tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:25.570900 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-57fb66ac-d3d7-4fce-90b6-eed190fa9a3b tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:25.571589 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-57fb66ac-d3d7-4fce-90b6-eed190fa9a3b tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:25.572030 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-57fb66ac-d3d7-4fce-90b6-eed190fa9a3b tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:25.572445 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-57fb66ac-d3d7-4fce-90b6-eed190fa9a3b tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:25.718008 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-57fb66ac-d3d7-4fce-90b6-eed190fa9a3b tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:25.726640 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-57fb66ac-d3d7-4fce-90b6-eed190fa9a3b tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.171157 Sep 06 21:14:25.727197 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 61/114] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:25 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:25.893277 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3d18f4e1-f237-490d-be97-757e3263173d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:25.894022 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3d18f4e1-f237-490d-be97-757e3263173d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:25.900431 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d18f4e1-f237-490d-be97-757e3263173d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:25.900938 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d18f4e1-f237-490d-be97-757e3263173d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:25.901364 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d18f4e1-f237-490d-be97-757e3263173d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:25.902060 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d18f4e1-f237-490d-be97-757e3263173d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:25.902497 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d18f4e1-f237-490d-be97-757e3263173d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:25.902911 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d18f4e1-f237-490d-be97-757e3263173d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:26.044891 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-54689c53-c502-429b-a269-c68e478dee75 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:26.045731 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-54689c53-c502-429b-a269-c68e478dee75 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:26.051721 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3d18f4e1-f237-490d-be97-757e3263173d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:26.060705 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3d18f4e1-f237-490d-be97-757e3263173d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:26.061626 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3d18f4e1-f237-490d-be97-757e3263173d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:26.062835 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3d18f4e1-f237-490d-be97-757e3263173d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.175210 Sep 06 21:14:26.063761 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 54/115] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:25 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:26.071963 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54689c53-c502-429b-a269-c68e478dee75 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:26.072444 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54689c53-c502-429b-a269-c68e478dee75 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:26.072939 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54689c53-c502-429b-a269-c68e478dee75 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:26.073647 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54689c53-c502-429b-a269-c68e478dee75 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:26.074081 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54689c53-c502-429b-a269-c68e478dee75 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:26.074539 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54689c53-c502-429b-a269-c68e478dee75 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:26.207241 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-54689c53-c502-429b-a269-c68e478dee75 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:26.215298 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-54689c53-c502-429b-a269-c68e478dee75 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.174418 Sep 06 21:14:26.215889 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 62/116] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:26 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:26.474074 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5495320f-5283-4a8f-9d40-6d61b18b9a25 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:26.474673 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5495320f-5283-4a8f-9d40-6d61b18b9a25 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:26.481448 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5495320f-5283-4a8f-9d40-6d61b18b9a25 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:26.481928 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5495320f-5283-4a8f-9d40-6d61b18b9a25 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:26.482354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5495320f-5283-4a8f-9d40-6d61b18b9a25 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:26.483044 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5495320f-5283-4a8f-9d40-6d61b18b9a25 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:26.483516 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5495320f-5283-4a8f-9d40-6d61b18b9a25 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:26.483932 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5495320f-5283-4a8f-9d40-6d61b18b9a25 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:26.642607 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5495320f-5283-4a8f-9d40-6d61b18b9a25 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:26.650895 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5495320f-5283-4a8f-9d40-6d61b18b9a25 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.181942 Sep 06 21:14:26.651481 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 55/117] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:26 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:26.749612 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d7e6b619-134e-4141-9247-59bedba4f81d tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:26.750219 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d7e6b619-134e-4141-9247-59bedba4f81d tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:26.757202 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7e6b619-134e-4141-9247-59bedba4f81d tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:26.757711 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7e6b619-134e-4141-9247-59bedba4f81d tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:26.758172 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7e6b619-134e-4141-9247-59bedba4f81d tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:26.758874 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7e6b619-134e-4141-9247-59bedba4f81d tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:26.759335 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7e6b619-134e-4141-9247-59bedba4f81d tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:26.759758 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7e6b619-134e-4141-9247-59bedba4f81d tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:26.903754 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d7e6b619-134e-4141-9247-59bedba4f81d tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:26.913592 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d7e6b619-134e-4141-9247-59bedba4f81d tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.166799 Sep 06 21:14:26.913592 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 63/118] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:26 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:27.088023 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4cd09f1f-83f2-43d9-bfd0-63c1c61238cd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:27.088818 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4cd09f1f-83f2-43d9-bfd0-63c1c61238cd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:27.095351 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cd09f1f-83f2-43d9-bfd0-63c1c61238cd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:27.095764 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cd09f1f-83f2-43d9-bfd0-63c1c61238cd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:27.096181 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cd09f1f-83f2-43d9-bfd0-63c1c61238cd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:27.096972 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cd09f1f-83f2-43d9-bfd0-63c1c61238cd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:27.097408 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cd09f1f-83f2-43d9-bfd0-63c1c61238cd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:27.097815 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cd09f1f-83f2-43d9-bfd0-63c1c61238cd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:27.239502 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-14b0bcae-4cea-4c63-a669-836721d8951b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:27.240115 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-14b0bcae-4cea-4c63-a669-836721d8951b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:27.246236 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14b0bcae-4cea-4c63-a669-836721d8951b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:27.246829 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14b0bcae-4cea-4c63-a669-836721d8951b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:27.247592 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14b0bcae-4cea-4c63-a669-836721d8951b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:27.248148 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14b0bcae-4cea-4c63-a669-836721d8951b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:27.248593 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14b0bcae-4cea-4c63-a669-836721d8951b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:27.249039 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14b0bcae-4cea-4c63-a669-836721d8951b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:27.260983 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4cd09f1f-83f2-43d9-bfd0-63c1c61238cd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:27.270047 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4cd09f1f-83f2-43d9-bfd0-63c1c61238cd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:27.271697 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4cd09f1f-83f2-43d9-bfd0-63c1c61238cd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:27.272888 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4cd09f1f-83f2-43d9-bfd0-63c1c61238cd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.189195 Sep 06 21:14:27.273630 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 56/119] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:27 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:27.378204 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-14b0bcae-4cea-4c63-a669-836721d8951b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:27.381791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:27.387062 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-14b0bcae-4cea-4c63-a669-836721d8951b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.151372 Sep 06 21:14:27.387630 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 64/120] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:27 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:27.675443 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f70475e2-e7d0-421e-9e12-cc97d7cddbdf tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:27.676052 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f70475e2-e7d0-421e-9e12-cc97d7cddbdf tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:27.682522 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f70475e2-e7d0-421e-9e12-cc97d7cddbdf tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:27.682958 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f70475e2-e7d0-421e-9e12-cc97d7cddbdf tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:27.683399 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f70475e2-e7d0-421e-9e12-cc97d7cddbdf tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:27.684093 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f70475e2-e7d0-421e-9e12-cc97d7cddbdf tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:27.684541 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f70475e2-e7d0-421e-9e12-cc97d7cddbdf tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:27.684991 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f70475e2-e7d0-421e-9e12-cc97d7cddbdf tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:27.715077 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:27.823620 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f70475e2-e7d0-421e-9e12-cc97d7cddbdf tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:27.835243 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f70475e2-e7d0-421e-9e12-cc97d7cddbdf tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.165099 Sep 06 21:14:27.835952 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 57/121] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:27 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:27.939252 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4c3120f9-10cd-4b45-acdb-711ba94952b9 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:27.939813 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4c3120f9-10cd-4b45-acdb-711ba94952b9 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:27.946704 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c3120f9-10cd-4b45-acdb-711ba94952b9 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:27.947178 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c3120f9-10cd-4b45-acdb-711ba94952b9 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:27.947631 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c3120f9-10cd-4b45-acdb-711ba94952b9 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:27.948308 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c3120f9-10cd-4b45-acdb-711ba94952b9 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:27.948777 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c3120f9-10cd-4b45-acdb-711ba94952b9 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:27.949184 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c3120f9-10cd-4b45-acdb-711ba94952b9 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:28.084277 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4c3120f9-10cd-4b45-acdb-711ba94952b9 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:28.092312 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4c3120f9-10cd-4b45-acdb-711ba94952b9 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.157096 Sep 06 21:14:28.093003 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 65/122] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:27 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:28.300123 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cd72e0b3-2f7b-4d8a-8239-95cb4bec4854 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:28.301108 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cd72e0b3-2f7b-4d8a-8239-95cb4bec4854 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:28.308056 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd72e0b3-2f7b-4d8a-8239-95cb4bec4854 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:28.309039 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd72e0b3-2f7b-4d8a-8239-95cb4bec4854 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:28.309529 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd72e0b3-2f7b-4d8a-8239-95cb4bec4854 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:28.310198 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd72e0b3-2f7b-4d8a-8239-95cb4bec4854 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:28.310713 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd72e0b3-2f7b-4d8a-8239-95cb4bec4854 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:28.311187 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd72e0b3-2f7b-4d8a-8239-95cb4bec4854 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:28.315641 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:28.410894 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a5bc3691-c415-49a4-ae98-c44a8f904985 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:28.411563 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a5bc3691-c415-49a4-ae98-c44a8f904985 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:28.418144 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5bc3691-c415-49a4-ae98-c44a8f904985 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:28.418590 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5bc3691-c415-49a4-ae98-c44a8f904985 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:28.419023 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5bc3691-c415-49a4-ae98-c44a8f904985 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:28.419754 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5bc3691-c415-49a4-ae98-c44a8f904985 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:28.420404 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5bc3691-c415-49a4-ae98-c44a8f904985 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:28.420876 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5bc3691-c415-49a4-ae98-c44a8f904985 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:28.555917 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a5bc3691-c415-49a4-ae98-c44a8f904985 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:28.564073 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a5bc3691-c415-49a4-ae98-c44a8f904985 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.157291 Sep 06 21:14:28.564669 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 66/123] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:28 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:28.641252 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cd72e0b3-2f7b-4d8a-8239-95cb4bec4854 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:28.651979 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cd72e0b3-2f7b-4d8a-8239-95cb4bec4854 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:28.652118 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cd72e0b3-2f7b-4d8a-8239-95cb4bec4854 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:28.653319 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cd72e0b3-2f7b-4d8a-8239-95cb4bec4854 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.358569 Sep 06 21:14:28.662427 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 58/124] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:28 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:28.863689 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4e158a60-bbf6-4aff-a936-70e9b06e1de6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:28.864391 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4e158a60-bbf6-4aff-a936-70e9b06e1de6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:28.871017 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e158a60-bbf6-4aff-a936-70e9b06e1de6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:28.871571 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e158a60-bbf6-4aff-a936-70e9b06e1de6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:28.872226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e158a60-bbf6-4aff-a936-70e9b06e1de6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:28.873078 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e158a60-bbf6-4aff-a936-70e9b06e1de6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:28.873846 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e158a60-bbf6-4aff-a936-70e9b06e1de6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:28.874290 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e158a60-bbf6-4aff-a936-70e9b06e1de6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:29.012731 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4e158a60-bbf6-4aff-a936-70e9b06e1de6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:29.023548 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4e158a60-bbf6-4aff-a936-70e9b06e1de6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.161951 Sep 06 21:14:29.039029 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 67/125] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:28 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:29.117354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-81a00199-ed1d-42ed-ae34-035242821ab7 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:29.118048 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-81a00199-ed1d-42ed-ae34-035242821ab7 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:29.124281 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81a00199-ed1d-42ed-ae34-035242821ab7 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:29.124801 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81a00199-ed1d-42ed-ae34-035242821ab7 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:29.125230 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81a00199-ed1d-42ed-ae34-035242821ab7 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:29.125968 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81a00199-ed1d-42ed-ae34-035242821ab7 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:29.126351 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81a00199-ed1d-42ed-ae34-035242821ab7 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:29.126770 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81a00199-ed1d-42ed-ae34-035242821ab7 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:29.184868 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-e1759eab-4f24-4a72-997e-8d13d59b51d3 req-328413b0-f8d3-45c5-9493-ed02d74ef547 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e16f683b-c2c3-4514-a197-cd5d4e109487", "tag": "4bfe4568-94b9-4729-ae44-82a7f49cc312"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:14:29.194670 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e1759eab-4f24-4a72-997e-8d13d59b51d3 req-328413b0-f8d3-45c5-9493-ed02d74ef547 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:29.195129 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e1759eab-4f24-4a72-997e-8d13d59b51d3 req-328413b0-f8d3-45c5-9493-ed02d74ef547 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:29.195543 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e1759eab-4f24-4a72-997e-8d13d59b51d3 req-328413b0-f8d3-45c5-9493-ed02d74ef547 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:29.208592 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-e1759eab-4f24-4a72-997e-8d13d59b51d3 req-328413b0-f8d3-45c5-9493-ed02d74ef547 service nova] Creating event network-changed:4bfe4568-94b9-4729-ae44-82a7f49cc312 for instance e16f683b-c2c3-4514-a197-cd5d4e109487 on hv-cinder-74915 Sep 06 21:14:29.213851 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-e1759eab-4f24-4a72-997e-8d13d59b51d3 req-328413b0-f8d3-45c5-9493-ed02d74ef547 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032577 Sep 06 21:14:29.214470 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 68/126] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:14:29.368324 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-81a00199-ed1d-42ed-ae34-035242821ab7 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:29.376112 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-81a00199-ed1d-42ed-ae34-035242821ab7 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.262815 Sep 06 21:14:29.376900 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 59/127] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:29 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:29.593007 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9460b68c-6946-4a54-abf5-4e8102925248 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:29.594976 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9460b68c-6946-4a54-abf5-4e8102925248 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:29.605603 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9460b68c-6946-4a54-abf5-4e8102925248 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:29.606540 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9460b68c-6946-4a54-abf5-4e8102925248 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:29.607252 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9460b68c-6946-4a54-abf5-4e8102925248 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:29.608393 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9460b68c-6946-4a54-abf5-4e8102925248 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:29.609175 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9460b68c-6946-4a54-abf5-4e8102925248 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:29.609867 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9460b68c-6946-4a54-abf5-4e8102925248 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:29.680424 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6ca8ac6f-7d32-4e1e-880b-cad22c6d7b2a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:29.681050 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6ca8ac6f-7d32-4e1e-880b-cad22c6d7b2a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:29.689142 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ca8ac6f-7d32-4e1e-880b-cad22c6d7b2a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:29.689829 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ca8ac6f-7d32-4e1e-880b-cad22c6d7b2a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:29.690452 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ca8ac6f-7d32-4e1e-880b-cad22c6d7b2a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:29.691151 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ca8ac6f-7d32-4e1e-880b-cad22c6d7b2a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:29.691625 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ca8ac6f-7d32-4e1e-880b-cad22c6d7b2a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:29.692032 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ca8ac6f-7d32-4e1e-880b-cad22c6d7b2a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:29.750791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9460b68c-6946-4a54-abf5-4e8102925248 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:29.759278 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9460b68c-6946-4a54-abf5-4e8102925248 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.173855 Sep 06 21:14:29.760193 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 69/128] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:29 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:29.825187 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6ca8ac6f-7d32-4e1e-880b-cad22c6d7b2a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:29.834647 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6ca8ac6f-7d32-4e1e-880b-cad22c6d7b2a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:29.836080 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6ca8ac6f-7d32-4e1e-880b-cad22c6d7b2a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:29.837225 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6ca8ac6f-7d32-4e1e-880b-cad22c6d7b2a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.161048 Sep 06 21:14:29.837776 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 60/129] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:29 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:30.047906 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-33ce7349-4a89-48ec-97db-8fd4022af702 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:30.048511 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-33ce7349-4a89-48ec-97db-8fd4022af702 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:30.050963 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:30.056551 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33ce7349-4a89-48ec-97db-8fd4022af702 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:30.057061 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33ce7349-4a89-48ec-97db-8fd4022af702 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:30.057488 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33ce7349-4a89-48ec-97db-8fd4022af702 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:30.058196 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33ce7349-4a89-48ec-97db-8fd4022af702 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:30.058636 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33ce7349-4a89-48ec-97db-8fd4022af702 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:30.059050 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33ce7349-4a89-48ec-97db-8fd4022af702 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:30.192339 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-33ce7349-4a89-48ec-97db-8fd4022af702 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:30.200765 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-33ce7349-4a89-48ec-97db-8fd4022af702 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.157502 Sep 06 21:14:30.201334 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 70/130] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:30 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:30.400477 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5e7591c6-daa8-49f3-a7de-df0d467fa9b2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:30.401095 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5e7591c6-daa8-49f3-a7de-df0d467fa9b2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:30.407537 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e7591c6-daa8-49f3-a7de-df0d467fa9b2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:30.408201 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e7591c6-daa8-49f3-a7de-df0d467fa9b2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:30.408606 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e7591c6-daa8-49f3-a7de-df0d467fa9b2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:30.409539 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e7591c6-daa8-49f3-a7de-df0d467fa9b2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:30.409980 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e7591c6-daa8-49f3-a7de-df0d467fa9b2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:30.410395 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e7591c6-daa8-49f3-a7de-df0d467fa9b2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:30.547367 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5e7591c6-daa8-49f3-a7de-df0d467fa9b2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:30.556099 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5e7591c6-daa8-49f3-a7de-df0d467fa9b2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.160378 Sep 06 21:14:30.556591 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 61/131] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:30 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:30.786607 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a2b431dd-9f88-462f-9984-57ce3d06b3b7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:30.786607 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a2b431dd-9f88-462f-9984-57ce3d06b3b7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:30.811589 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2b431dd-9f88-462f-9984-57ce3d06b3b7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:30.812082 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2b431dd-9f88-462f-9984-57ce3d06b3b7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:30.812517 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2b431dd-9f88-462f-9984-57ce3d06b3b7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:30.813293 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2b431dd-9f88-462f-9984-57ce3d06b3b7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:30.814051 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2b431dd-9f88-462f-9984-57ce3d06b3b7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:30.814862 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2b431dd-9f88-462f-9984-57ce3d06b3b7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:30.871131 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-07519b76-2098-4337-be35-cbc37f48f9f5 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:30.871725 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-07519b76-2098-4337-be35-cbc37f48f9f5 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:30.878247 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07519b76-2098-4337-be35-cbc37f48f9f5 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:30.878666 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07519b76-2098-4337-be35-cbc37f48f9f5 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:30.879095 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07519b76-2098-4337-be35-cbc37f48f9f5 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:30.879861 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07519b76-2098-4337-be35-cbc37f48f9f5 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:30.880301 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07519b76-2098-4337-be35-cbc37f48f9f5 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:30.880766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07519b76-2098-4337-be35-cbc37f48f9f5 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:30.961777 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a2b431dd-9f88-462f-9984-57ce3d06b3b7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:30.970266 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a2b431dd-9f88-462f-9984-57ce3d06b3b7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.190882 Sep 06 21:14:30.970958 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 71/132] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:30 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:31.027153 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-07519b76-2098-4337-be35-cbc37f48f9f5 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:31.039003 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-07519b76-2098-4337-be35-cbc37f48f9f5 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:31.039839 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-07519b76-2098-4337-be35-cbc37f48f9f5 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:31.040969 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-07519b76-2098-4337-be35-cbc37f48f9f5 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.173693 Sep 06 21:14:31.041738 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 62/133] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:30 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:31.224785 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ec8429ea-2793-44c0-97f1-f52400bac75e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:31.225345 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ec8429ea-2793-44c0-97f1-f52400bac75e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:31.233033 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec8429ea-2793-44c0-97f1-f52400bac75e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:31.233519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec8429ea-2793-44c0-97f1-f52400bac75e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:31.233948 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec8429ea-2793-44c0-97f1-f52400bac75e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:31.234879 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec8429ea-2793-44c0-97f1-f52400bac75e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:31.235431 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec8429ea-2793-44c0-97f1-f52400bac75e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:31.235833 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec8429ea-2793-44c0-97f1-f52400bac75e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:31.243674 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-65c2392d-8ac9-4977-824a-1b6291e391fc req-e0c68f53-62d5-4822-ab2c-c4c97977243a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c787b30-603f-4b67-b10c-519b49f5e43f", "tag": "69b5a869-9450-44f8-b04d-e9ee1b517313"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:14:31.253314 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-65c2392d-8ac9-4977-824a-1b6291e391fc req-e0c68f53-62d5-4822-ab2c-c4c97977243a service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:31.253751 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-65c2392d-8ac9-4977-824a-1b6291e391fc req-e0c68f53-62d5-4822-ab2c-c4c97977243a service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:31.254350 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-65c2392d-8ac9-4977-824a-1b6291e391fc req-e0c68f53-62d5-4822-ab2c-c4c97977243a service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:31.265736 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-65c2392d-8ac9-4977-824a-1b6291e391fc req-e0c68f53-62d5-4822-ab2c-c4c97977243a service nova] Creating event network-changed:69b5a869-9450-44f8-b04d-e9ee1b517313 for instance 9c787b30-603f-4b67-b10c-519b49f5e43f on hv-cinder-74915 Sep 06 21:14:31.270836 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-65c2392d-8ac9-4977-824a-1b6291e391fc req-e0c68f53-62d5-4822-ab2c-c4c97977243a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030785 Sep 06 21:14:31.271432 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 63/134] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:14:31.378080 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ec8429ea-2793-44c0-97f1-f52400bac75e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:31.386312 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ec8429ea-2793-44c0-97f1-f52400bac75e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.165998 Sep 06 21:14:31.386933 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 72/135] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:31 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:31.579804 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-241bad84-1009-4e95-80ca-bc09543ac200 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:31.580478 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-241bad84-1009-4e95-80ca-bc09543ac200 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:31.588447 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-241bad84-1009-4e95-80ca-bc09543ac200 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:31.588987 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-241bad84-1009-4e95-80ca-bc09543ac200 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:31.589386 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-241bad84-1009-4e95-80ca-bc09543ac200 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:31.590106 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-241bad84-1009-4e95-80ca-bc09543ac200 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:31.590561 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-241bad84-1009-4e95-80ca-bc09543ac200 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:31.591041 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-241bad84-1009-4e95-80ca-bc09543ac200 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:31.736303 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-241bad84-1009-4e95-80ca-bc09543ac200 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:31.748856 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-241bad84-1009-4e95-80ca-bc09543ac200 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.173577 Sep 06 21:14:31.749514 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 64/136] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:31 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:31.993326 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-db0d0d31-a58e-4b53-bd2b-206240c063a8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:31.993829 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-db0d0d31-a58e-4b53-bd2b-206240c063a8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:32.001115 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db0d0d31-a58e-4b53-bd2b-206240c063a8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:32.001589 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db0d0d31-a58e-4b53-bd2b-206240c063a8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:32.002034 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db0d0d31-a58e-4b53-bd2b-206240c063a8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:32.002716 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db0d0d31-a58e-4b53-bd2b-206240c063a8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:32.003149 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db0d0d31-a58e-4b53-bd2b-206240c063a8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:32.003560 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db0d0d31-a58e-4b53-bd2b-206240c063a8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:32.066360 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1fdecccc-924a-428d-bb6c-826ce422282c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:32.066969 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1fdecccc-924a-428d-bb6c-826ce422282c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:32.073273 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1fdecccc-924a-428d-bb6c-826ce422282c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:32.073784 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1fdecccc-924a-428d-bb6c-826ce422282c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:32.074195 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1fdecccc-924a-428d-bb6c-826ce422282c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:32.074879 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1fdecccc-924a-428d-bb6c-826ce422282c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:32.075327 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1fdecccc-924a-428d-bb6c-826ce422282c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:32.075725 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1fdecccc-924a-428d-bb6c-826ce422282c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:32.136599 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-db0d0d31-a58e-4b53-bd2b-206240c063a8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:32.145298 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-db0d0d31-a58e-4b53-bd2b-206240c063a8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.155990 Sep 06 21:14:32.145904 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 73/137] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:31 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:32.210288 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1fdecccc-924a-428d-bb6c-826ce422282c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:32.218817 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1fdecccc-924a-428d-bb6c-826ce422282c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:32.220211 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1fdecccc-924a-428d-bb6c-826ce422282c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:32.221339 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1fdecccc-924a-428d-bb6c-826ce422282c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.158962 Sep 06 21:14:32.222012 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 65/138] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:32 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:32.412385 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-41503b1e-36d5-45ef-8872-578a21b6c098 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:32.414294 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-41503b1e-36d5-45ef-8872-578a21b6c098 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:32.422505 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41503b1e-36d5-45ef-8872-578a21b6c098 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:32.423034 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41503b1e-36d5-45ef-8872-578a21b6c098 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:32.423446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41503b1e-36d5-45ef-8872-578a21b6c098 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:32.424982 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41503b1e-36d5-45ef-8872-578a21b6c098 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:32.425432 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41503b1e-36d5-45ef-8872-578a21b6c098 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:32.425926 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41503b1e-36d5-45ef-8872-578a21b6c098 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:32.605635 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-41503b1e-36d5-45ef-8872-578a21b6c098 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:32.614568 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-41503b1e-36d5-45ef-8872-578a21b6c098 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.208580 Sep 06 21:14:32.615163 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 74/139] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:32 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:32.772003 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9168936e-68c6-4ad3-93d4-b8b9134a9e87 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:32.772599 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9168936e-68c6-4ad3-93d4-b8b9134a9e87 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:32.780372 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9168936e-68c6-4ad3-93d4-b8b9134a9e87 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:32.785601 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9168936e-68c6-4ad3-93d4-b8b9134a9e87 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:32.786041 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9168936e-68c6-4ad3-93d4-b8b9134a9e87 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:32.786749 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9168936e-68c6-4ad3-93d4-b8b9134a9e87 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:32.787355 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9168936e-68c6-4ad3-93d4-b8b9134a9e87 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:32.787965 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9168936e-68c6-4ad3-93d4-b8b9134a9e87 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:33.044467 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9168936e-68c6-4ad3-93d4-b8b9134a9e87 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:33.053453 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9168936e-68c6-4ad3-93d4-b8b9134a9e87 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.285749 Sep 06 21:14:33.054033 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 66/140] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:32 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:33.167790 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-00d6fd2f-2a63-4ce6-bb99-e7c7fa060f47 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:33.168754 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-00d6fd2f-2a63-4ce6-bb99-e7c7fa060f47 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:33.177955 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00d6fd2f-2a63-4ce6-bb99-e7c7fa060f47 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:33.178732 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00d6fd2f-2a63-4ce6-bb99-e7c7fa060f47 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:33.179266 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00d6fd2f-2a63-4ce6-bb99-e7c7fa060f47 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:33.180065 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00d6fd2f-2a63-4ce6-bb99-e7c7fa060f47 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:33.180634 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00d6fd2f-2a63-4ce6-bb99-e7c7fa060f47 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:33.181151 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00d6fd2f-2a63-4ce6-bb99-e7c7fa060f47 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:33.249784 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fe50f960-5e28-4151-afa5-7f84ece14a7b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:33.250550 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fe50f960-5e28-4151-afa5-7f84ece14a7b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:33.258619 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe50f960-5e28-4151-afa5-7f84ece14a7b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:33.259097 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe50f960-5e28-4151-afa5-7f84ece14a7b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:33.259515 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe50f960-5e28-4151-afa5-7f84ece14a7b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:33.260283 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe50f960-5e28-4151-afa5-7f84ece14a7b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:33.260919 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe50f960-5e28-4151-afa5-7f84ece14a7b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:33.261472 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe50f960-5e28-4151-afa5-7f84ece14a7b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:33.549944 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fe50f960-5e28-4151-afa5-7f84ece14a7b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:33.566241 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fe50f960-5e28-4151-afa5-7f84ece14a7b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:33.567589 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fe50f960-5e28-4151-afa5-7f84ece14a7b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:33.568971 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fe50f960-5e28-4151-afa5-7f84ece14a7b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.326195 Sep 06 21:14:33.569611 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 67/141] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:33 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:33.640950 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d9713c58-8cc8-410f-97ad-9cf1eaaa9404 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:33.642021 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d9713c58-8cc8-410f-97ad-9cf1eaaa9404 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:33.649624 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d9713c58-8cc8-410f-97ad-9cf1eaaa9404 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:33.650882 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d9713c58-8cc8-410f-97ad-9cf1eaaa9404 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:33.651572 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-00d6fd2f-2a63-4ce6-bb99-e7c7fa060f47 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:33.652158 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d9713c58-8cc8-410f-97ad-9cf1eaaa9404 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:33.653113 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d9713c58-8cc8-410f-97ad-9cf1eaaa9404 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:33.653857 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d9713c58-8cc8-410f-97ad-9cf1eaaa9404 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:33.654416 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d9713c58-8cc8-410f-97ad-9cf1eaaa9404 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:33.673227 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-00d6fd2f-2a63-4ce6-bb99-e7c7fa060f47 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.497223 Sep 06 21:14:33.673227 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 75/142] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:33 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:33.829882 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d9713c58-8cc8-410f-97ad-9cf1eaaa9404 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:33.843039 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d9713c58-8cc8-410f-97ad-9cf1eaaa9404 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.208370 Sep 06 21:14:33.843626 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 68/143] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:33 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:34.079387 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-29979cc8-5add-4407-b1b7-1ef9597a4391 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:34.080014 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-29979cc8-5add-4407-b1b7-1ef9597a4391 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:34.087126 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29979cc8-5add-4407-b1b7-1ef9597a4391 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:34.087629 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29979cc8-5add-4407-b1b7-1ef9597a4391 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:34.088020 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29979cc8-5add-4407-b1b7-1ef9597a4391 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:34.088764 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29979cc8-5add-4407-b1b7-1ef9597a4391 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:34.089205 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29979cc8-5add-4407-b1b7-1ef9597a4391 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:34.090201 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-29979cc8-5add-4407-b1b7-1ef9597a4391 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:34.251670 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-29979cc8-5add-4407-b1b7-1ef9597a4391 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:34.260424 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-29979cc8-5add-4407-b1b7-1ef9597a4391 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.184997 Sep 06 21:14:34.261025 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 76/144] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:34 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:34.614826 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2014acd3-eb05-4692-a8e0-971b8ce5e5a7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:34.615424 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2014acd3-eb05-4692-a8e0-971b8ce5e5a7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:34.622155 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2014acd3-eb05-4692-a8e0-971b8ce5e5a7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:34.622655 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2014acd3-eb05-4692-a8e0-971b8ce5e5a7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:34.623048 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2014acd3-eb05-4692-a8e0-971b8ce5e5a7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:34.623732 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2014acd3-eb05-4692-a8e0-971b8ce5e5a7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:34.624168 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2014acd3-eb05-4692-a8e0-971b8ce5e5a7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:34.624574 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2014acd3-eb05-4692-a8e0-971b8ce5e5a7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:34.685192 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cb4b4a35-9b72-4fb2-9df9-5b825027e656 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:34.685774 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cb4b4a35-9b72-4fb2-9df9-5b825027e656 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:34.693849 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb4b4a35-9b72-4fb2-9df9-5b825027e656 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:34.694320 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb4b4a35-9b72-4fb2-9df9-5b825027e656 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:34.694969 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb4b4a35-9b72-4fb2-9df9-5b825027e656 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:34.695845 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb4b4a35-9b72-4fb2-9df9-5b825027e656 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:34.696479 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb4b4a35-9b72-4fb2-9df9-5b825027e656 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:34.696954 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb4b4a35-9b72-4fb2-9df9-5b825027e656 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:34.770732 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2014acd3-eb05-4692-a8e0-971b8ce5e5a7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:34.778916 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2014acd3-eb05-4692-a8e0-971b8ce5e5a7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:34.780412 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2014acd3-eb05-4692-a8e0-971b8ce5e5a7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:34.781561 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2014acd3-eb05-4692-a8e0-971b8ce5e5a7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.170690 Sep 06 21:14:34.782121 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 69/145] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:34 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:34.834290 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-cb4b4a35-9b72-4fb2-9df9-5b825027e656 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:34.842652 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cb4b4a35-9b72-4fb2-9df9-5b825027e656 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.161532 Sep 06 21:14:34.843177 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 77/146] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:34 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:34.867771 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-df22b67e-272e-4a36-bf20-505cd24bd703 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:34.868366 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-df22b67e-272e-4a36-bf20-505cd24bd703 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:34.874895 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df22b67e-272e-4a36-bf20-505cd24bd703 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:34.875370 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df22b67e-272e-4a36-bf20-505cd24bd703 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:34.875793 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df22b67e-272e-4a36-bf20-505cd24bd703 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:34.876479 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df22b67e-272e-4a36-bf20-505cd24bd703 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:34.876962 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df22b67e-272e-4a36-bf20-505cd24bd703 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:34.877374 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df22b67e-272e-4a36-bf20-505cd24bd703 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:35.019517 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-df22b67e-272e-4a36-bf20-505cd24bd703 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:35.027889 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-df22b67e-272e-4a36-bf20-505cd24bd703 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.163990 Sep 06 21:14:35.028471 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 70/147] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:34 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:35.283819 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6d84a0b2-488d-452f-8f23-c1936657e525 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:35.284832 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6d84a0b2-488d-452f-8f23-c1936657e525 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:35.291776 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d84a0b2-488d-452f-8f23-c1936657e525 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:35.292231 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d84a0b2-488d-452f-8f23-c1936657e525 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:35.292690 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d84a0b2-488d-452f-8f23-c1936657e525 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:35.293388 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d84a0b2-488d-452f-8f23-c1936657e525 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:35.293827 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d84a0b2-488d-452f-8f23-c1936657e525 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:35.294239 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d84a0b2-488d-452f-8f23-c1936657e525 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:35.447710 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6d84a0b2-488d-452f-8f23-c1936657e525 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:35.455499 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6d84a0b2-488d-452f-8f23-c1936657e525 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.175676 Sep 06 21:14:35.456099 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 78/148] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:35 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:35.807343 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8caeaf65-9b4c-48ac-b1ac-3e4f7e535b28 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:35.807944 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8caeaf65-9b4c-48ac-b1ac-3e4f7e535b28 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:35.814412 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8caeaf65-9b4c-48ac-b1ac-3e4f7e535b28 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:35.814885 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8caeaf65-9b4c-48ac-b1ac-3e4f7e535b28 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:35.815319 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8caeaf65-9b4c-48ac-b1ac-3e4f7e535b28 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:35.816012 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8caeaf65-9b4c-48ac-b1ac-3e4f7e535b28 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:35.816432 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8caeaf65-9b4c-48ac-b1ac-3e4f7e535b28 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:35.816882 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8caeaf65-9b4c-48ac-b1ac-3e4f7e535b28 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:35.871616 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8a228d7c-ef8e-49f6-b622-27a5959cd21f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:35.872171 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8a228d7c-ef8e-49f6-b622-27a5959cd21f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:35.878289 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a228d7c-ef8e-49f6-b622-27a5959cd21f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:35.878765 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a228d7c-ef8e-49f6-b622-27a5959cd21f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:35.879934 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a228d7c-ef8e-49f6-b622-27a5959cd21f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:35.880637 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a228d7c-ef8e-49f6-b622-27a5959cd21f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:35.881122 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a228d7c-ef8e-49f6-b622-27a5959cd21f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:35.881539 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a228d7c-ef8e-49f6-b622-27a5959cd21f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:35.953819 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8caeaf65-9b4c-48ac-b1ac-3e4f7e535b28 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:35.962365 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8caeaf65-9b4c-48ac-b1ac-3e4f7e535b28 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:35.963758 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8caeaf65-9b4c-48ac-b1ac-3e4f7e535b28 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:35.964914 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8caeaf65-9b4c-48ac-b1ac-3e4f7e535b28 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.161500 Sep 06 21:14:35.965472 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 71/149] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:35 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:36.016798 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8a228d7c-ef8e-49f6-b622-27a5959cd21f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:36.025064 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8a228d7c-ef8e-49f6-b622-27a5959cd21f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.157479 Sep 06 21:14:36.025619 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 79/150] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:35 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:14:36.051111 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-32c011e1-1d14-4ccf-97a0-deb7e293113b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:36.051712 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-32c011e1-1d14-4ccf-97a0-deb7e293113b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:36.057716 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32c011e1-1d14-4ccf-97a0-deb7e293113b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:36.058183 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32c011e1-1d14-4ccf-97a0-deb7e293113b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:36.058606 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32c011e1-1d14-4ccf-97a0-deb7e293113b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:36.059287 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32c011e1-1d14-4ccf-97a0-deb7e293113b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:36.059725 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32c011e1-1d14-4ccf-97a0-deb7e293113b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:36.060141 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32c011e1-1d14-4ccf-97a0-deb7e293113b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:36.198380 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-32c011e1-1d14-4ccf-97a0-deb7e293113b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:36.207998 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-32c011e1-1d14-4ccf-97a0-deb7e293113b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.161035 Sep 06 21:14:36.208571 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 72/151] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:36 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:36.478719 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-22e4b7a3-094c-4a33-9491-7a5ff1b4d907 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:36.479320 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-22e4b7a3-094c-4a33-9491-7a5ff1b4d907 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:36.485946 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22e4b7a3-094c-4a33-9491-7a5ff1b4d907 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:36.486422 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22e4b7a3-094c-4a33-9491-7a5ff1b4d907 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:36.486837 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22e4b7a3-094c-4a33-9491-7a5ff1b4d907 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:36.487590 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22e4b7a3-094c-4a33-9491-7a5ff1b4d907 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:36.488023 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22e4b7a3-094c-4a33-9491-7a5ff1b4d907 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:36.488440 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22e4b7a3-094c-4a33-9491-7a5ff1b4d907 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:36.625660 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-22e4b7a3-094c-4a33-9491-7a5ff1b4d907 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:36.633963 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-22e4b7a3-094c-4a33-9491-7a5ff1b4d907 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.159076 Sep 06 21:14:36.634506 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 80/152] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:36 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:36.991765 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b85d166e-99be-4053-84c1-f3f2e128e438 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:36.992371 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b85d166e-99be-4053-84c1-f3f2e128e438 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:37.004004 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b85d166e-99be-4053-84c1-f3f2e128e438 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:37.004823 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b85d166e-99be-4053-84c1-f3f2e128e438 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:37.005649 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b85d166e-99be-4053-84c1-f3f2e128e438 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:37.006537 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b85d166e-99be-4053-84c1-f3f2e128e438 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:37.007128 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b85d166e-99be-4053-84c1-f3f2e128e438 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:37.007873 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b85d166e-99be-4053-84c1-f3f2e128e438 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:37.048158 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-efef1d08-ad94-4284-acc9-1b65b3cf0632 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:37.048880 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-efef1d08-ad94-4284-acc9-1b65b3cf0632 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:37.055741 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-efef1d08-ad94-4284-acc9-1b65b3cf0632 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:37.056215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-efef1d08-ad94-4284-acc9-1b65b3cf0632 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:37.056867 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-efef1d08-ad94-4284-acc9-1b65b3cf0632 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:37.057617 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-efef1d08-ad94-4284-acc9-1b65b3cf0632 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:37.058007 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-efef1d08-ad94-4284-acc9-1b65b3cf0632 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:37.058424 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-efef1d08-ad94-4284-acc9-1b65b3cf0632 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:37.283011 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b85d166e-99be-4053-84c1-f3f2e128e438 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:37.291505 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b85d166e-99be-4053-84c1-f3f2e128e438 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:37.292961 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b85d166e-99be-4053-84c1-f3f2e128e438 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:37.294086 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b85d166e-99be-4053-84c1-f3f2e128e438 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.307706 Sep 06 21:14:37.294610 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 73/153] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:36 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:37.303595 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-32d9e989-15c8-482c-aa53-abae31be3835 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:37.304199 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-32d9e989-15c8-482c-aa53-abae31be3835 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:37.310935 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32d9e989-15c8-482c-aa53-abae31be3835 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:37.311722 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32d9e989-15c8-482c-aa53-abae31be3835 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:37.312239 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32d9e989-15c8-482c-aa53-abae31be3835 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:37.312985 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32d9e989-15c8-482c-aa53-abae31be3835 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:37.313435 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32d9e989-15c8-482c-aa53-abae31be3835 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:37.313960 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32d9e989-15c8-482c-aa53-abae31be3835 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:37.346258 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-efef1d08-ad94-4284-acc9-1b65b3cf0632 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:37.354483 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-efef1d08-ad94-4284-acc9-1b65b3cf0632 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.310561 Sep 06 21:14:37.355064 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 81/154] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:37 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:14:37.658468 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d59aa1ee-36ac-4bce-9ef4-52da89af7c53 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:37.659310 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d59aa1ee-36ac-4bce-9ef4-52da89af7c53 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:37.666502 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d59aa1ee-36ac-4bce-9ef4-52da89af7c53 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:37.666996 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d59aa1ee-36ac-4bce-9ef4-52da89af7c53 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:37.667540 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d59aa1ee-36ac-4bce-9ef4-52da89af7c53 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:37.668705 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d59aa1ee-36ac-4bce-9ef4-52da89af7c53 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:37.669165 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d59aa1ee-36ac-4bce-9ef4-52da89af7c53 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:37.669606 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d59aa1ee-36ac-4bce-9ef4-52da89af7c53 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:37.674902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:37.875243 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-32d9e989-15c8-482c-aa53-abae31be3835 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:37.891338 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-32d9e989-15c8-482c-aa53-abae31be3835 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.595180 Sep 06 21:14:37.892624 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 74/155] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:37 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:37.950153 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d59aa1ee-36ac-4bce-9ef4-52da89af7c53 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:37.959174 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d59aa1ee-36ac-4bce-9ef4-52da89af7c53 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.305822 Sep 06 21:14:37.960022 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 82/156] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:37 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:14:38.319639 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2ac8bc6d-0448-461c-89dc-d57987f7e4a9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:38.320240 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2ac8bc6d-0448-461c-89dc-d57987f7e4a9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:38.326481 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ac8bc6d-0448-461c-89dc-d57987f7e4a9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:38.326952 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ac8bc6d-0448-461c-89dc-d57987f7e4a9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:38.327378 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ac8bc6d-0448-461c-89dc-d57987f7e4a9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:38.328062 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ac8bc6d-0448-461c-89dc-d57987f7e4a9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:38.328508 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ac8bc6d-0448-461c-89dc-d57987f7e4a9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:38.328947 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ac8bc6d-0448-461c-89dc-d57987f7e4a9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:38.349514 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:38.377779 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-afd5a41c-d801-4782-8b61-b89e6e783d12 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:38.379001 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-afd5a41c-d801-4782-8b61-b89e6e783d12 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:38.385806 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afd5a41c-d801-4782-8b61-b89e6e783d12 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:38.386439 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afd5a41c-d801-4782-8b61-b89e6e783d12 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:38.387049 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afd5a41c-d801-4782-8b61-b89e6e783d12 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:38.387896 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afd5a41c-d801-4782-8b61-b89e6e783d12 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:38.388489 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afd5a41c-d801-4782-8b61-b89e6e783d12 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:38.389354 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afd5a41c-d801-4782-8b61-b89e6e783d12 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:38.475127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2ac8bc6d-0448-461c-89dc-d57987f7e4a9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:38.483896 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2ac8bc6d-0448-461c-89dc-d57987f7e4a9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:38.485493 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2ac8bc6d-0448-461c-89dc-d57987f7e4a9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:38.486604 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2ac8bc6d-0448-461c-89dc-d57987f7e4a9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.171006 Sep 06 21:14:38.487189 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 75/157] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:38 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:38.532033 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-afd5a41c-d801-4782-8b61-b89e6e783d12 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:38.540499 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-afd5a41c-d801-4782-8b61-b89e6e783d12 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.166751 Sep 06 21:14:38.541293 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 83/158] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:38 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:38.915426 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d20bddfc-3278-4e28-97f7-e24a02d2b5b4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:38.916097 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d20bddfc-3278-4e28-97f7-e24a02d2b5b4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:38.925813 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d20bddfc-3278-4e28-97f7-e24a02d2b5b4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:38.926327 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d20bddfc-3278-4e28-97f7-e24a02d2b5b4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:38.926750 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d20bddfc-3278-4e28-97f7-e24a02d2b5b4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:38.927728 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d20bddfc-3278-4e28-97f7-e24a02d2b5b4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:38.928875 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d20bddfc-3278-4e28-97f7-e24a02d2b5b4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:38.929567 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d20bddfc-3278-4e28-97f7-e24a02d2b5b4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:38.984379 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d87030b4-13f0-4333-b54f-1656b5b9bf5e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:38.985046 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d87030b4-13f0-4333-b54f-1656b5b9bf5e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:38.991907 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d87030b4-13f0-4333-b54f-1656b5b9bf5e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:38.992438 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d87030b4-13f0-4333-b54f-1656b5b9bf5e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:38.992919 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d87030b4-13f0-4333-b54f-1656b5b9bf5e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:38.993605 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d87030b4-13f0-4333-b54f-1656b5b9bf5e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:38.994045 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d87030b4-13f0-4333-b54f-1656b5b9bf5e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:38.994424 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d87030b4-13f0-4333-b54f-1656b5b9bf5e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:39.095894 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d20bddfc-3278-4e28-97f7-e24a02d2b5b4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:39.103728 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d20bddfc-3278-4e28-97f7-e24a02d2b5b4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.192343 Sep 06 21:14:39.104295 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 76/159] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:38 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:39.136045 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d87030b4-13f0-4333-b54f-1656b5b9bf5e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:39.144803 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d87030b4-13f0-4333-b54f-1656b5b9bf5e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.164740 Sep 06 21:14:39.145394 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 84/160] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:38 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:39.511719 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d7fcbc0-4fed-45a4-984e-2490f0c826f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:39.512432 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7d7fcbc0-4fed-45a4-984e-2490f0c826f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:39.518882 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d7fcbc0-4fed-45a4-984e-2490f0c826f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:39.519362 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d7fcbc0-4fed-45a4-984e-2490f0c826f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:39.519790 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d7fcbc0-4fed-45a4-984e-2490f0c826f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:39.520475 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d7fcbc0-4fed-45a4-984e-2490f0c826f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:39.520948 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d7fcbc0-4fed-45a4-984e-2490f0c826f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:39.521366 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d7fcbc0-4fed-45a4-984e-2490f0c826f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:39.563373 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-75793212-af33-462c-99a2-0d91b79b82f5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:39.564079 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-75793212-af33-462c-99a2-0d91b79b82f5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:39.570449 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75793212-af33-462c-99a2-0d91b79b82f5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:39.571121 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75793212-af33-462c-99a2-0d91b79b82f5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:39.571547 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75793212-af33-462c-99a2-0d91b79b82f5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:39.572235 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75793212-af33-462c-99a2-0d91b79b82f5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:39.572705 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75793212-af33-462c-99a2-0d91b79b82f5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:39.573124 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75793212-af33-462c-99a2-0d91b79b82f5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:39.657962 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7d7fcbc0-4fed-45a4-984e-2490f0c826f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:39.666319 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7d7fcbc0-4fed-45a4-984e-2490f0c826f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:39.667732 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7d7fcbc0-4fed-45a4-984e-2490f0c826f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:39.669144 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7d7fcbc0-4fed-45a4-984e-2490f0c826f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.161131 Sep 06 21:14:39.669704 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 77/161] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:39 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:39.710409 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-75793212-af33-462c-99a2-0d91b79b82f5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:39.718648 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-75793212-af33-462c-99a2-0d91b79b82f5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.159141 Sep 06 21:14:39.719205 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 85/162] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:39 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:40.131033 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dc8c7f75-5b89-41be-b165-801741a4a920 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:40.132046 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dc8c7f75-5b89-41be-b165-801741a4a920 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:40.142642 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dc8c7f75-5b89-41be-b165-801741a4a920 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:40.143434 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dc8c7f75-5b89-41be-b165-801741a4a920 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:40.144218 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dc8c7f75-5b89-41be-b165-801741a4a920 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:40.144951 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dc8c7f75-5b89-41be-b165-801741a4a920 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:40.145401 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dc8c7f75-5b89-41be-b165-801741a4a920 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:40.145820 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dc8c7f75-5b89-41be-b165-801741a4a920 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:40.167481 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-31b0e819-e16c-4714-9aa5-42bbcca14b46 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:40.168206 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-31b0e819-e16c-4714-9aa5-42bbcca14b46 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:40.175221 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31b0e819-e16c-4714-9aa5-42bbcca14b46 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:40.175761 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31b0e819-e16c-4714-9aa5-42bbcca14b46 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:40.176194 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31b0e819-e16c-4714-9aa5-42bbcca14b46 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:40.176929 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31b0e819-e16c-4714-9aa5-42bbcca14b46 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:40.177369 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31b0e819-e16c-4714-9aa5-42bbcca14b46 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:40.177787 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31b0e819-e16c-4714-9aa5-42bbcca14b46 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:40.277387 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-dc8c7f75-5b89-41be-b165-801741a4a920 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:40.285929 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dc8c7f75-5b89-41be-b165-801741a4a920 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.161491 Sep 06 21:14:40.292740 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 78/163] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:40 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:40.317142 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-31b0e819-e16c-4714-9aa5-42bbcca14b46 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:40.325004 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-31b0e819-e16c-4714-9aa5-42bbcca14b46 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.161316 Sep 06 21:14:40.325690 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 86/164] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:40 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:14:40.697301 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e97262a0-6776-425b-affa-36071b8d698d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:40.698016 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e97262a0-6776-425b-affa-36071b8d698d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:40.706881 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e97262a0-6776-425b-affa-36071b8d698d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:40.707444 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e97262a0-6776-425b-affa-36071b8d698d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:40.707998 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e97262a0-6776-425b-affa-36071b8d698d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:40.709013 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e97262a0-6776-425b-affa-36071b8d698d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:40.709569 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e97262a0-6776-425b-affa-36071b8d698d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:40.710213 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e97262a0-6776-425b-affa-36071b8d698d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:40.741855 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-12e2dc35-bfb0-4d32-bc93-81548f3f720f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:40.742490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-12e2dc35-bfb0-4d32-bc93-81548f3f720f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:40.751039 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12e2dc35-bfb0-4d32-bc93-81548f3f720f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:40.751716 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12e2dc35-bfb0-4d32-bc93-81548f3f720f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:40.752467 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12e2dc35-bfb0-4d32-bc93-81548f3f720f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:40.753553 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12e2dc35-bfb0-4d32-bc93-81548f3f720f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:40.754019 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12e2dc35-bfb0-4d32-bc93-81548f3f720f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:40.754431 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12e2dc35-bfb0-4d32-bc93-81548f3f720f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:40.856259 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e97262a0-6776-425b-affa-36071b8d698d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:40.864700 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e97262a0-6776-425b-affa-36071b8d698d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:40.866112 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e97262a0-6776-425b-affa-36071b8d698d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:40.867244 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e97262a0-6776-425b-affa-36071b8d698d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.175741 Sep 06 21:14:40.867786 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 79/165] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:40 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:40.892217 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-12e2dc35-bfb0-4d32-bc93-81548f3f720f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:40.904724 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-12e2dc35-bfb0-4d32-bc93-81548f3f720f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.166405 Sep 06 21:14:40.905532 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 87/166] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:40 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:41.314410 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7c466685-457f-4bca-8c5f-b75e5cffd847 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:41.315397 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7c466685-457f-4bca-8c5f-b75e5cffd847 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:41.322191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c466685-457f-4bca-8c5f-b75e5cffd847 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:41.322689 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c466685-457f-4bca-8c5f-b75e5cffd847 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:41.323124 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c466685-457f-4bca-8c5f-b75e5cffd847 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:41.323800 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c466685-457f-4bca-8c5f-b75e5cffd847 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:41.324240 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c466685-457f-4bca-8c5f-b75e5cffd847 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:41.324682 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c466685-457f-4bca-8c5f-b75e5cffd847 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:41.348246 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0625d2a0-516a-4ba1-92be-9425012cbf7c tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:41.348881 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0625d2a0-516a-4ba1-92be-9425012cbf7c tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:41.355054 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0625d2a0-516a-4ba1-92be-9425012cbf7c tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:41.355521 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0625d2a0-516a-4ba1-92be-9425012cbf7c tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:41.355948 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0625d2a0-516a-4ba1-92be-9425012cbf7c tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:41.356800 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0625d2a0-516a-4ba1-92be-9425012cbf7c tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:41.357256 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0625d2a0-516a-4ba1-92be-9425012cbf7c tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:41.357677 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0625d2a0-516a-4ba1-92be-9425012cbf7c tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:41.452861 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7c466685-457f-4bca-8c5f-b75e5cffd847 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:41.460683 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7c466685-457f-4bca-8c5f-b75e5cffd847 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.152947 Sep 06 21:14:41.461264 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 80/167] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:41 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:41.490292 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0625d2a0-516a-4ba1-92be-9425012cbf7c tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:41.498202 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0625d2a0-516a-4ba1-92be-9425012cbf7c tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.153979 Sep 06 21:14:41.498777 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 88/168] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:41 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:41.895202 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ffae80b0-5188-4cc4-826f-5cafc5e83030 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:41.895830 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ffae80b0-5188-4cc4-826f-5cafc5e83030 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:41.902146 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffae80b0-5188-4cc4-826f-5cafc5e83030 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:41.902556 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffae80b0-5188-4cc4-826f-5cafc5e83030 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:41.902977 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffae80b0-5188-4cc4-826f-5cafc5e83030 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:41.904173 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffae80b0-5188-4cc4-826f-5cafc5e83030 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:41.904622 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffae80b0-5188-4cc4-826f-5cafc5e83030 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:41.905073 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffae80b0-5188-4cc4-826f-5cafc5e83030 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:41.935634 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-afc7d7d9-7820-472b-a0ed-16e4cb376870 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:41.936394 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-afc7d7d9-7820-472b-a0ed-16e4cb376870 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:41.943099 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afc7d7d9-7820-472b-a0ed-16e4cb376870 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:41.943645 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afc7d7d9-7820-472b-a0ed-16e4cb376870 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:41.944139 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afc7d7d9-7820-472b-a0ed-16e4cb376870 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:41.944925 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afc7d7d9-7820-472b-a0ed-16e4cb376870 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:41.945375 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afc7d7d9-7820-472b-a0ed-16e4cb376870 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:41.945789 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afc7d7d9-7820-472b-a0ed-16e4cb376870 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:42.053632 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ffae80b0-5188-4cc4-826f-5cafc5e83030 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:42.062454 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ffae80b0-5188-4cc4-826f-5cafc5e83030 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:42.063967 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ffae80b0-5188-4cc4-826f-5cafc5e83030 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:42.065516 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ffae80b0-5188-4cc4-826f-5cafc5e83030 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.176480 Sep 06 21:14:42.066227 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 81/169] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:41 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:42.081144 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-afc7d7d9-7820-472b-a0ed-16e4cb376870 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:42.089800 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-afc7d7d9-7820-472b-a0ed-16e4cb376870 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.158196 Sep 06 21:14:42.090370 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 89/170] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:41 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:42.484341 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7146dbc3-7d9d-47e4-9565-f6da410a48e1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:42.484968 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7146dbc3-7d9d-47e4-9565-f6da410a48e1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:42.492645 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7146dbc3-7d9d-47e4-9565-f6da410a48e1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:42.493238 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7146dbc3-7d9d-47e4-9565-f6da410a48e1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:42.493663 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7146dbc3-7d9d-47e4-9565-f6da410a48e1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:42.494359 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7146dbc3-7d9d-47e4-9565-f6da410a48e1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:42.494787 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7146dbc3-7d9d-47e4-9565-f6da410a48e1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:42.495201 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7146dbc3-7d9d-47e4-9565-f6da410a48e1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:42.521481 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-72d1fc89-c9c8-42e2-9e66-998fa065183d tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:42.522098 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-72d1fc89-c9c8-42e2-9e66-998fa065183d tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:42.528832 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72d1fc89-c9c8-42e2-9e66-998fa065183d tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:42.529256 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72d1fc89-c9c8-42e2-9e66-998fa065183d tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:42.529649 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72d1fc89-c9c8-42e2-9e66-998fa065183d tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:42.530547 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72d1fc89-c9c8-42e2-9e66-998fa065183d tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:42.530990 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72d1fc89-c9c8-42e2-9e66-998fa065183d tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:42.531403 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72d1fc89-c9c8-42e2-9e66-998fa065183d tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:42.640159 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7146dbc3-7d9d-47e4-9565-f6da410a48e1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:42.648744 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7146dbc3-7d9d-47e4-9565-f6da410a48e1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.168302 Sep 06 21:14:42.649342 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 82/171] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:42 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:42.677393 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-72d1fc89-c9c8-42e2-9e66-998fa065183d tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:42.688446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-72d1fc89-c9c8-42e2-9e66-998fa065183d tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.170823 Sep 06 21:14:42.689286 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 90/172] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:42 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:43.094894 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-718b99d3-e0b4-4bda-b0b3-fe304b669889 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:43.095885 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-718b99d3-e0b4-4bda-b0b3-fe304b669889 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:43.106766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-718b99d3-e0b4-4bda-b0b3-fe304b669889 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:43.107311 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-718b99d3-e0b4-4bda-b0b3-fe304b669889 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:43.108025 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-718b99d3-e0b4-4bda-b0b3-fe304b669889 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:43.109228 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-718b99d3-e0b4-4bda-b0b3-fe304b669889 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:43.109979 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-718b99d3-e0b4-4bda-b0b3-fe304b669889 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:43.110671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-718b99d3-e0b4-4bda-b0b3-fe304b669889 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:43.115326 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3c68c62b-59a2-4752-8d35-3fca9016d85c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:43.115938 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3c68c62b-59a2-4752-8d35-3fca9016d85c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:43.122208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c68c62b-59a2-4752-8d35-3fca9016d85c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:43.122716 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c68c62b-59a2-4752-8d35-3fca9016d85c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:43.123144 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c68c62b-59a2-4752-8d35-3fca9016d85c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:43.123845 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c68c62b-59a2-4752-8d35-3fca9016d85c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:43.124293 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c68c62b-59a2-4752-8d35-3fca9016d85c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:43.124741 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3c68c62b-59a2-4752-8d35-3fca9016d85c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:43.245605 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-718b99d3-e0b4-4bda-b0b3-fe304b669889 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:43.253970 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-718b99d3-e0b4-4bda-b0b3-fe304b669889 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:43.255839 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-718b99d3-e0b4-4bda-b0b3-fe304b669889 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:43.256885 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3c68c62b-59a2-4752-8d35-3fca9016d85c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:43.257035 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-718b99d3-e0b4-4bda-b0b3-fe304b669889 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.169044 Sep 06 21:14:43.257519 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 83/173] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:43 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:43.265533 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3c68c62b-59a2-4752-8d35-3fca9016d85c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.155314 Sep 06 21:14:43.266097 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 91/174] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:43 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:43.671577 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1d78105c-e4bf-41c0-af19-3dc898f8ef54 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:43.672175 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1d78105c-e4bf-41c0-af19-3dc898f8ef54 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:43.678944 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d78105c-e4bf-41c0-af19-3dc898f8ef54 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:43.679419 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d78105c-e4bf-41c0-af19-3dc898f8ef54 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:43.679849 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d78105c-e4bf-41c0-af19-3dc898f8ef54 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:43.680537 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d78105c-e4bf-41c0-af19-3dc898f8ef54 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:43.681010 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d78105c-e4bf-41c0-af19-3dc898f8ef54 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:43.681422 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d78105c-e4bf-41c0-af19-3dc898f8ef54 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:43.711672 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-97630b20-369c-4caf-9178-99e61a436ab2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:43.712267 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-97630b20-369c-4caf-9178-99e61a436ab2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:43.718900 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-97630b20-369c-4caf-9178-99e61a436ab2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:43.719376 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-97630b20-369c-4caf-9178-99e61a436ab2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:43.719807 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-97630b20-369c-4caf-9178-99e61a436ab2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:43.720491 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-97630b20-369c-4caf-9178-99e61a436ab2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:43.720957 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-97630b20-369c-4caf-9178-99e61a436ab2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:43.721589 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-97630b20-369c-4caf-9178-99e61a436ab2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:43.811022 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1d78105c-e4bf-41c0-af19-3dc898f8ef54 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:43.818754 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1d78105c-e4bf-41c0-af19-3dc898f8ef54 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.151101 Sep 06 21:14:43.819325 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 84/175] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:43 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:43.851791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-97630b20-369c-4caf-9178-99e61a436ab2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:43.859665 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-97630b20-369c-4caf-9178-99e61a436ab2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.151845 Sep 06 21:14:43.860224 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 92/176] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:43 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:44.285609 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7b8e6069-7f9c-4e01-8494-4b1710e93295 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:44.286244 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7b8e6069-7f9c-4e01-8494-4b1710e93295 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:44.289423 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-112f5c19-e604-4eae-8f5b-267dd9a0b572 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:44.290023 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-112f5c19-e604-4eae-8f5b-267dd9a0b572 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:44.293037 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b8e6069-7f9c-4e01-8494-4b1710e93295 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:44.293626 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b8e6069-7f9c-4e01-8494-4b1710e93295 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:44.294059 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b8e6069-7f9c-4e01-8494-4b1710e93295 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:44.294777 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b8e6069-7f9c-4e01-8494-4b1710e93295 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:44.295188 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b8e6069-7f9c-4e01-8494-4b1710e93295 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:44.295587 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b8e6069-7f9c-4e01-8494-4b1710e93295 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:44.296278 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-112f5c19-e604-4eae-8f5b-267dd9a0b572 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:44.296828 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-112f5c19-e604-4eae-8f5b-267dd9a0b572 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:44.297256 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-112f5c19-e604-4eae-8f5b-267dd9a0b572 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:44.297972 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-112f5c19-e604-4eae-8f5b-267dd9a0b572 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:44.298436 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-112f5c19-e604-4eae-8f5b-267dd9a0b572 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:44.299078 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-112f5c19-e604-4eae-8f5b-267dd9a0b572 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:44.428080 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7b8e6069-7f9c-4e01-8494-4b1710e93295 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:44.430363 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-112f5c19-e604-4eae-8f5b-267dd9a0b572 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:44.438184 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-112f5c19-e604-4eae-8f5b-267dd9a0b572 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.152582 Sep 06 21:14:44.438343 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7b8e6069-7f9c-4e01-8494-4b1710e93295 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:44.438794 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 93/177] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:44 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:44.439936 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7b8e6069-7f9c-4e01-8494-4b1710e93295 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:44.441185 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7b8e6069-7f9c-4e01-8494-4b1710e93295 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.161638 Sep 06 21:14:44.441747 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 85/178] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:44 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:44.842267 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6e4bd679-6734-4f03-8047-0271503034e5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:44.842872 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6e4bd679-6734-4f03-8047-0271503034e5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:44.849061 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e4bd679-6734-4f03-8047-0271503034e5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:44.849542 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e4bd679-6734-4f03-8047-0271503034e5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:44.849968 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e4bd679-6734-4f03-8047-0271503034e5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:44.850652 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e4bd679-6734-4f03-8047-0271503034e5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:44.851097 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e4bd679-6734-4f03-8047-0271503034e5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:44.851512 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e4bd679-6734-4f03-8047-0271503034e5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:44.882644 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bb0a767b-b245-4e5e-84ee-31d00e2ec3c7 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:44.883492 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bb0a767b-b245-4e5e-84ee-31d00e2ec3c7 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:44.889955 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb0a767b-b245-4e5e-84ee-31d00e2ec3c7 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:44.890426 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb0a767b-b245-4e5e-84ee-31d00e2ec3c7 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:44.890848 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb0a767b-b245-4e5e-84ee-31d00e2ec3c7 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:44.891560 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb0a767b-b245-4e5e-84ee-31d00e2ec3c7 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:44.891977 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb0a767b-b245-4e5e-84ee-31d00e2ec3c7 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:44.892455 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb0a767b-b245-4e5e-84ee-31d00e2ec3c7 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:44.980604 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6e4bd679-6734-4f03-8047-0271503034e5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:44.988591 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6e4bd679-6734-4f03-8047-0271503034e5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.150272 Sep 06 21:14:44.989279 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 94/179] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:44 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:45.028463 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bb0a767b-b245-4e5e-84ee-31d00e2ec3c7 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:45.038363 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bb0a767b-b245-4e5e-84ee-31d00e2ec3c7 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.159579 Sep 06 21:14:45.038898 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 86/180] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:44 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:45.463269 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5c3d4fd5-f088-4113-a5d6-d6051fa834a2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:45.463895 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5c3d4fd5-f088-4113-a5d6-d6051fa834a2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:45.466048 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-504b8ffe-9ab8-4eae-b800-b277c984547c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:45.466654 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-504b8ffe-9ab8-4eae-b800-b277c984547c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:45.470370 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c3d4fd5-f088-4113-a5d6-d6051fa834a2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:45.470848 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c3d4fd5-f088-4113-a5d6-d6051fa834a2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:45.471369 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c3d4fd5-f088-4113-a5d6-d6051fa834a2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:45.471962 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c3d4fd5-f088-4113-a5d6-d6051fa834a2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:45.472405 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c3d4fd5-f088-4113-a5d6-d6051fa834a2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:45.472936 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-504b8ffe-9ab8-4eae-b800-b277c984547c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:45.473100 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c3d4fd5-f088-4113-a5d6-d6051fa834a2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:45.473391 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-504b8ffe-9ab8-4eae-b800-b277c984547c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:45.473815 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-504b8ffe-9ab8-4eae-b800-b277c984547c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:45.474510 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-504b8ffe-9ab8-4eae-b800-b277c984547c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:45.474974 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-504b8ffe-9ab8-4eae-b800-b277c984547c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:45.475388 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-504b8ffe-9ab8-4eae-b800-b277c984547c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:45.613389 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5c3d4fd5-f088-4113-a5d6-d6051fa834a2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:45.622206 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5c3d4fd5-f088-4113-a5d6-d6051fa834a2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.162942 Sep 06 21:14:45.624698 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 95/181] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:45 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:45.625329 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-504b8ffe-9ab8-4eae-b800-b277c984547c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:45.636850 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-504b8ffe-9ab8-4eae-b800-b277c984547c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:45.638310 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-504b8ffe-9ab8-4eae-b800-b277c984547c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:45.640266 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-504b8ffe-9ab8-4eae-b800-b277c984547c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.178027 Sep 06 21:14:45.641314 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 87/182] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:45 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:46.017526 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4e1085fd-2b03-4a71-8914-d3b6da561f43 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:46.018086 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4e1085fd-2b03-4a71-8914-d3b6da561f43 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:46.024508 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e1085fd-2b03-4a71-8914-d3b6da561f43 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:46.024999 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e1085fd-2b03-4a71-8914-d3b6da561f43 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:46.025403 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e1085fd-2b03-4a71-8914-d3b6da561f43 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:46.026134 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e1085fd-2b03-4a71-8914-d3b6da561f43 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:46.026536 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e1085fd-2b03-4a71-8914-d3b6da561f43 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:46.026951 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e1085fd-2b03-4a71-8914-d3b6da561f43 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:46.061797 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c6bce777-ff4a-40f0-82db-eb0ff39d9763 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:46.062466 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c6bce777-ff4a-40f0-82db-eb0ff39d9763 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:46.077472 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6bce777-ff4a-40f0-82db-eb0ff39d9763 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:46.077962 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6bce777-ff4a-40f0-82db-eb0ff39d9763 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:46.078448 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6bce777-ff4a-40f0-82db-eb0ff39d9763 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:46.079198 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6bce777-ff4a-40f0-82db-eb0ff39d9763 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:46.079745 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6bce777-ff4a-40f0-82db-eb0ff39d9763 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:46.080194 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6bce777-ff4a-40f0-82db-eb0ff39d9763 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:46.177752 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4e1085fd-2b03-4a71-8914-d3b6da561f43 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:46.185858 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4e1085fd-2b03-4a71-8914-d3b6da561f43 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.175320 Sep 06 21:14:46.186411 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 96/183] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:46 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:46.230674 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c6bce777-ff4a-40f0-82db-eb0ff39d9763 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:46.238788 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c6bce777-ff4a-40f0-82db-eb0ff39d9763 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.181502 Sep 06 21:14:46.239333 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 88/184] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:46 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:46.650585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-92eae3bf-61a3-4a01-afc8-5db65066fcea tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:46.651115 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-92eae3bf-61a3-4a01-afc8-5db65066fcea tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:46.657620 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92eae3bf-61a3-4a01-afc8-5db65066fcea tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:46.658089 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92eae3bf-61a3-4a01-afc8-5db65066fcea tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:46.658509 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92eae3bf-61a3-4a01-afc8-5db65066fcea tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:46.659185 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92eae3bf-61a3-4a01-afc8-5db65066fcea tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:46.659740 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92eae3bf-61a3-4a01-afc8-5db65066fcea tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:46.660150 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92eae3bf-61a3-4a01-afc8-5db65066fcea tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:46.665830 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0cd197a0-d7e8-4b63-9535-0b67a17efb58 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:46.666441 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0cd197a0-d7e8-4b63-9535-0b67a17efb58 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:46.672802 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0cd197a0-d7e8-4b63-9535-0b67a17efb58 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:46.673278 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0cd197a0-d7e8-4b63-9535-0b67a17efb58 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:46.673702 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0cd197a0-d7e8-4b63-9535-0b67a17efb58 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:46.674385 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0cd197a0-d7e8-4b63-9535-0b67a17efb58 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:46.675200 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0cd197a0-d7e8-4b63-9535-0b67a17efb58 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:46.675866 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0cd197a0-d7e8-4b63-9535-0b67a17efb58 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:46.793167 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-92eae3bf-61a3-4a01-afc8-5db65066fcea tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:46.801665 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-92eae3bf-61a3-4a01-afc8-5db65066fcea tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.154975 Sep 06 21:14:46.802255 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 97/185] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:46 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:46.807546 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0cd197a0-d7e8-4b63-9535-0b67a17efb58 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:46.816835 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0cd197a0-d7e8-4b63-9535-0b67a17efb58 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:46.818249 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0cd197a0-d7e8-4b63-9535-0b67a17efb58 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:46.819710 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0cd197a0-d7e8-4b63-9535-0b67a17efb58 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.157470 Sep 06 21:14:46.820568 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 89/186] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:46 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:47.213515 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-072049dc-c643-449e-8d55-02be5d41cedd tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:47.214401 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-072049dc-c643-449e-8d55-02be5d41cedd tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:47.225081 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-072049dc-c643-449e-8d55-02be5d41cedd tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:47.225557 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-072049dc-c643-449e-8d55-02be5d41cedd tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:47.225982 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-072049dc-c643-449e-8d55-02be5d41cedd tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:47.226671 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-072049dc-c643-449e-8d55-02be5d41cedd tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:47.227115 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-072049dc-c643-449e-8d55-02be5d41cedd tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:47.227530 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-072049dc-c643-449e-8d55-02be5d41cedd tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:47.262389 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-034cbfb6-76d8-423f-913e-26c602f4e9ca tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:47.263028 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-034cbfb6-76d8-423f-913e-26c602f4e9ca tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:47.269729 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-034cbfb6-76d8-423f-913e-26c602f4e9ca tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:47.270179 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-034cbfb6-76d8-423f-913e-26c602f4e9ca tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:47.270607 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-034cbfb6-76d8-423f-913e-26c602f4e9ca tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:47.271304 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-034cbfb6-76d8-423f-913e-26c602f4e9ca tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:47.271746 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-034cbfb6-76d8-423f-913e-26c602f4e9ca tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:47.272160 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-034cbfb6-76d8-423f-913e-26c602f4e9ca tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:47.362892 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-072049dc-c643-449e-8d55-02be5d41cedd tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:47.366913 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:47.372849 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-072049dc-c643-449e-8d55-02be5d41cedd tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.165925 Sep 06 21:14:47.373436 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 98/187] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:47 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:47.414537 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-034cbfb6-76d8-423f-913e-26c602f4e9ca tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:47.422220 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-034cbfb6-76d8-423f-913e-26c602f4e9ca tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.163764 Sep 06 21:14:47.422769 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 90/188] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:47 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:47.827294 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-747c1cff-0359-4a35-9c42-e81ff9f046f2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:47.828151 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-747c1cff-0359-4a35-9c42-e81ff9f046f2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:47.835934 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-747c1cff-0359-4a35-9c42-e81ff9f046f2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:47.836420 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-747c1cff-0359-4a35-9c42-e81ff9f046f2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:47.836962 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-747c1cff-0359-4a35-9c42-e81ff9f046f2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:47.837661 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-747c1cff-0359-4a35-9c42-e81ff9f046f2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:47.839452 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-747c1cff-0359-4a35-9c42-e81ff9f046f2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:47.839452 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-747c1cff-0359-4a35-9c42-e81ff9f046f2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:47.844885 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3bf8ef39-bf51-4605-8031-4d53c66211ee tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:47.845548 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3bf8ef39-bf51-4605-8031-4d53c66211ee tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:47.852173 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bf8ef39-bf51-4605-8031-4d53c66211ee tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:47.852646 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bf8ef39-bf51-4605-8031-4d53c66211ee tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:47.853159 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bf8ef39-bf51-4605-8031-4d53c66211ee tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:47.853910 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bf8ef39-bf51-4605-8031-4d53c66211ee tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:47.854934 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bf8ef39-bf51-4605-8031-4d53c66211ee tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:47.854934 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bf8ef39-bf51-4605-8031-4d53c66211ee tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:47.973828 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-747c1cff-0359-4a35-9c42-e81ff9f046f2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:47.981893 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-747c1cff-0359-4a35-9c42-e81ff9f046f2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.160302 Sep 06 21:14:47.982463 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 99/189] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:47 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:47.996509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3bf8ef39-bf51-4605-8031-4d53c66211ee tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:48.005022 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3bf8ef39-bf51-4605-8031-4d53c66211ee tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:48.006491 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3bf8ef39-bf51-4605-8031-4d53c66211ee tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:48.007559 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3bf8ef39-bf51-4605-8031-4d53c66211ee tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.166716 Sep 06 21:14:48.008111 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 91/190] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:47 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:48.398308 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-11ba8ec8-b248-4b4d-b144-94e3efb9c9f6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:48.399154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-11ba8ec8-b248-4b4d-b144-94e3efb9c9f6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:48.408226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-11ba8ec8-b248-4b4d-b144-94e3efb9c9f6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:48.408921 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-11ba8ec8-b248-4b4d-b144-94e3efb9c9f6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:48.409412 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-11ba8ec8-b248-4b4d-b144-94e3efb9c9f6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:48.410172 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-11ba8ec8-b248-4b4d-b144-94e3efb9c9f6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:48.410737 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-11ba8ec8-b248-4b4d-b144-94e3efb9c9f6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:48.411164 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-11ba8ec8-b248-4b4d-b144-94e3efb9c9f6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:48.445808 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0eaeed6e-18ef-4938-adb0-e3b47b83009f tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:48.446434 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0eaeed6e-18ef-4938-adb0-e3b47b83009f tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:48.453109 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0eaeed6e-18ef-4938-adb0-e3b47b83009f tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:48.454271 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0eaeed6e-18ef-4938-adb0-e3b47b83009f tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:48.454271 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0eaeed6e-18ef-4938-adb0-e3b47b83009f tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:48.455035 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0eaeed6e-18ef-4938-adb0-e3b47b83009f tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:48.455355 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0eaeed6e-18ef-4938-adb0-e3b47b83009f tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:48.457933 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0eaeed6e-18ef-4938-adb0-e3b47b83009f tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:48.462666 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:48.555318 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-11ba8ec8-b248-4b4d-b144-94e3efb9c9f6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:48.564690 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-11ba8ec8-b248-4b4d-b144-94e3efb9c9f6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.171914 Sep 06 21:14:48.565289 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 100/191] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:48 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:48.597362 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0eaeed6e-18ef-4938-adb0-e3b47b83009f tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:48.605352 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0eaeed6e-18ef-4938-adb0-e3b47b83009f tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.163737 Sep 06 21:14:48.605934 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 92/192] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:48 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:49.005704 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cb541ff4-c22f-4f7b-8ffd-3518417fbe7a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:49.006636 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cb541ff4-c22f-4f7b-8ffd-3518417fbe7a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:49.009836 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:49.013646 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb541ff4-c22f-4f7b-8ffd-3518417fbe7a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:49.014114 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb541ff4-c22f-4f7b-8ffd-3518417fbe7a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:49.014537 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb541ff4-c22f-4f7b-8ffd-3518417fbe7a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:49.015214 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb541ff4-c22f-4f7b-8ffd-3518417fbe7a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:49.015650 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb541ff4-c22f-4f7b-8ffd-3518417fbe7a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:49.016060 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb541ff4-c22f-4f7b-8ffd-3518417fbe7a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:49.033236 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8df61e26-3003-467d-8a80-969898555566 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:49.034329 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8df61e26-3003-467d-8a80-969898555566 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:49.041331 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8df61e26-3003-467d-8a80-969898555566 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:49.041802 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8df61e26-3003-467d-8a80-969898555566 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:49.042228 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8df61e26-3003-467d-8a80-969898555566 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:49.042934 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8df61e26-3003-467d-8a80-969898555566 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:49.043374 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8df61e26-3003-467d-8a80-969898555566 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:49.043806 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8df61e26-3003-467d-8a80-969898555566 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:49.155930 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-cb541ff4-c22f-4f7b-8ffd-3518417fbe7a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:49.163695 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cb541ff4-c22f-4f7b-8ffd-3518417fbe7a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.162500 Sep 06 21:14:49.164268 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 101/193] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:48 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:49.183343 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8df61e26-3003-467d-8a80-969898555566 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:49.191703 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8df61e26-3003-467d-8a80-969898555566 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:49.193092 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8df61e26-3003-467d-8a80-969898555566 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:49.194169 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8df61e26-3003-467d-8a80-969898555566 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.165129 Sep 06 21:14:49.194746 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 93/194] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:49 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:49.588096 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bc64f38a-4759-4318-8859-829f6e233dea tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:49.589871 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bc64f38a-4759-4318-8859-829f6e233dea tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:49.596323 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc64f38a-4759-4318-8859-829f6e233dea tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:49.596976 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc64f38a-4759-4318-8859-829f6e233dea tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:49.597411 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc64f38a-4759-4318-8859-829f6e233dea tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:49.598152 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc64f38a-4759-4318-8859-829f6e233dea tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:49.598610 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc64f38a-4759-4318-8859-829f6e233dea tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:49.599030 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc64f38a-4759-4318-8859-829f6e233dea tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:49.628307 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4ca66987-6e9a-4615-aad1-6781974f5c12 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:49.628960 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4ca66987-6e9a-4615-aad1-6781974f5c12 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:49.631880 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:49.635538 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ca66987-6e9a-4615-aad1-6781974f5c12 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:49.636012 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ca66987-6e9a-4615-aad1-6781974f5c12 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:49.636432 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ca66987-6e9a-4615-aad1-6781974f5c12 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:49.637142 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ca66987-6e9a-4615-aad1-6781974f5c12 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:49.637559 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ca66987-6e9a-4615-aad1-6781974f5c12 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:49.637968 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ca66987-6e9a-4615-aad1-6781974f5c12 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:49.734103 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-bc64f38a-4759-4318-8859-829f6e233dea tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:49.742162 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bc64f38a-4759-4318-8859-829f6e233dea tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.158211 Sep 06 21:14:49.743108 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 102/195] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:49 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:49.774306 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4ca66987-6e9a-4615-aad1-6781974f5c12 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:49.782547 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4ca66987-6e9a-4615-aad1-6781974f5c12 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.158045 Sep 06 21:14:49.783124 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 94/196] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:49 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:50.186605 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-33d726df-f81e-487f-869f-3b766b003efb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:50.187243 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-33d726df-f81e-487f-869f-3b766b003efb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:50.193640 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33d726df-f81e-487f-869f-3b766b003efb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:50.194118 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33d726df-f81e-487f-869f-3b766b003efb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:50.194543 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33d726df-f81e-487f-869f-3b766b003efb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:50.195228 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33d726df-f81e-487f-869f-3b766b003efb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:50.195671 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33d726df-f81e-487f-869f-3b766b003efb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:50.196083 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33d726df-f81e-487f-869f-3b766b003efb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:50.222680 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d29f57a8-1cf4-4f52-85ee-2bdf9a80725e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:50.223340 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d29f57a8-1cf4-4f52-85ee-2bdf9a80725e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:50.230329 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d29f57a8-1cf4-4f52-85ee-2bdf9a80725e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:50.230955 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d29f57a8-1cf4-4f52-85ee-2bdf9a80725e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:50.231625 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d29f57a8-1cf4-4f52-85ee-2bdf9a80725e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:50.232577 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d29f57a8-1cf4-4f52-85ee-2bdf9a80725e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:50.233114 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d29f57a8-1cf4-4f52-85ee-2bdf9a80725e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:50.233570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d29f57a8-1cf4-4f52-85ee-2bdf9a80725e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:50.366361 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-33d726df-f81e-487f-869f-3b766b003efb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:50.376099 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-33d726df-f81e-487f-869f-3b766b003efb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.193257 Sep 06 21:14:50.376710 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 103/197] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:50 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:50.385424 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d29f57a8-1cf4-4f52-85ee-2bdf9a80725e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:50.393971 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d29f57a8-1cf4-4f52-85ee-2bdf9a80725e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:50.395583 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d29f57a8-1cf4-4f52-85ee-2bdf9a80725e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:50.396820 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d29f57a8-1cf4-4f52-85ee-2bdf9a80725e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.178801 Sep 06 21:14:50.397438 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 95/198] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:50 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 21:14:50.765328 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-50471d9f-334c-4115-82c1-a48f9c982888 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:50.766194 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-50471d9f-334c-4115-82c1-a48f9c982888 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:50.774344 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50471d9f-334c-4115-82c1-a48f9c982888 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:50.774830 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50471d9f-334c-4115-82c1-a48f9c982888 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:50.775976 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50471d9f-334c-4115-82c1-a48f9c982888 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:50.776098 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50471d9f-334c-4115-82c1-a48f9c982888 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:50.776484 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50471d9f-334c-4115-82c1-a48f9c982888 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:50.777008 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50471d9f-334c-4115-82c1-a48f9c982888 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:50.808750 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b614aad7-9eb7-4916-b417-12d231e92589 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:50.809603 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b614aad7-9eb7-4916-b417-12d231e92589 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:50.815956 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b614aad7-9eb7-4916-b417-12d231e92589 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:50.816422 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b614aad7-9eb7-4916-b417-12d231e92589 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:50.816875 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b614aad7-9eb7-4916-b417-12d231e92589 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:50.817562 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b614aad7-9eb7-4916-b417-12d231e92589 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:50.817996 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b614aad7-9eb7-4916-b417-12d231e92589 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:50.818406 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b614aad7-9eb7-4916-b417-12d231e92589 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:50.992587 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b614aad7-9eb7-4916-b417-12d231e92589 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:51.001537 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b614aad7-9eb7-4916-b417-12d231e92589 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.200103 Sep 06 21:14:51.002117 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 96/199] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:50 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:14:51.199235 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-50471d9f-334c-4115-82c1-a48f9c982888 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:51.210149 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-50471d9f-334c-4115-82c1-a48f9c982888 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.448739 Sep 06 21:14:51.225198 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 104/200] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:50 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:51.400964 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-524a8031-6f6b-4670-bdb0-b3a56f30206f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:51.402091 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-524a8031-6f6b-4670-bdb0-b3a56f30206f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:51.408415 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-524a8031-6f6b-4670-bdb0-b3a56f30206f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:51.409124 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-524a8031-6f6b-4670-bdb0-b3a56f30206f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:51.409832 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-524a8031-6f6b-4670-bdb0-b3a56f30206f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:51.410699 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-524a8031-6f6b-4670-bdb0-b3a56f30206f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:51.411311 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-524a8031-6f6b-4670-bdb0-b3a56f30206f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:51.411872 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-524a8031-6f6b-4670-bdb0-b3a56f30206f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:51.422213 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-537fec0b-c81b-4f0f-b109-f9f51ee342be tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:51.423137 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-537fec0b-c81b-4f0f-b109-f9f51ee342be tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:51.432259 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-537fec0b-c81b-4f0f-b109-f9f51ee342be tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:51.433116 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-537fec0b-c81b-4f0f-b109-f9f51ee342be tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:51.433755 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-537fec0b-c81b-4f0f-b109-f9f51ee342be tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:51.434736 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-537fec0b-c81b-4f0f-b109-f9f51ee342be tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:51.435830 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-537fec0b-c81b-4f0f-b109-f9f51ee342be tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:51.436531 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-537fec0b-c81b-4f0f-b109-f9f51ee342be tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:51.615580 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-537fec0b-c81b-4f0f-b109-f9f51ee342be tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:51.624848 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-537fec0b-c81b-4f0f-b109-f9f51ee342be tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:51.626585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-537fec0b-c81b-4f0f-b109-f9f51ee342be tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:51.627775 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-537fec0b-c81b-4f0f-b109-f9f51ee342be tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.209884 Sep 06 21:14:51.628592 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 105/201] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:51 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 21:14:51.657709 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-524a8031-6f6b-4670-bdb0-b3a56f30206f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:51.666414 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-524a8031-6f6b-4670-bdb0-b3a56f30206f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.270575 Sep 06 21:14:51.666997 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 97/202] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:51 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:52.035353 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b795f3d4-4d8b-4755-8905-ab729549fa05 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:52.035957 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b795f3d4-4d8b-4755-8905-ab729549fa05 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:52.043155 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b795f3d4-4d8b-4755-8905-ab729549fa05 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:52.044552 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b795f3d4-4d8b-4755-8905-ab729549fa05 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:52.044552 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b795f3d4-4d8b-4755-8905-ab729549fa05 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:52.045227 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b795f3d4-4d8b-4755-8905-ab729549fa05 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:52.045501 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b795f3d4-4d8b-4755-8905-ab729549fa05 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:52.046303 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b795f3d4-4d8b-4755-8905-ab729549fa05 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:52.205185 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b795f3d4-4d8b-4755-8905-ab729549fa05 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:52.214786 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b795f3d4-4d8b-4755-8905-ab729549fa05 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.183395 Sep 06 21:14:52.215930 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 106/203] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:52 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:52.236596 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-63ecce93-19d5-4330-bec5-7a2ad31ffe51 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:52.237230 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-63ecce93-19d5-4330-bec5-7a2ad31ffe51 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:52.244354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63ecce93-19d5-4330-bec5-7a2ad31ffe51 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:52.245025 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63ecce93-19d5-4330-bec5-7a2ad31ffe51 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:52.245627 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63ecce93-19d5-4330-bec5-7a2ad31ffe51 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:52.246354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63ecce93-19d5-4330-bec5-7a2ad31ffe51 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:52.247134 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63ecce93-19d5-4330-bec5-7a2ad31ffe51 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:52.247562 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63ecce93-19d5-4330-bec5-7a2ad31ffe51 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:52.435852 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-63ecce93-19d5-4330-bec5-7a2ad31ffe51 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:52.443591 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-63ecce93-19d5-4330-bec5-7a2ad31ffe51 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.213003 Sep 06 21:14:52.444153 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 98/204] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:52 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:52.654402 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7e0f1288-4f85-4c65-931d-3c2322a673a0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:52.655038 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7e0f1288-4f85-4c65-931d-3c2322a673a0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:52.661598 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e0f1288-4f85-4c65-931d-3c2322a673a0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:52.662077 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e0f1288-4f85-4c65-931d-3c2322a673a0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:52.662542 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e0f1288-4f85-4c65-931d-3c2322a673a0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:52.663547 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e0f1288-4f85-4c65-931d-3c2322a673a0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:52.664212 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e0f1288-4f85-4c65-931d-3c2322a673a0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:52.664837 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e0f1288-4f85-4c65-931d-3c2322a673a0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:52.690072 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3b77b335-93e0-4382-8bd8-0b38dfa87440 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:52.690676 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3b77b335-93e0-4382-8bd8-0b38dfa87440 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:52.698062 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b77b335-93e0-4382-8bd8-0b38dfa87440 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:52.698574 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b77b335-93e0-4382-8bd8-0b38dfa87440 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:52.704774 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b77b335-93e0-4382-8bd8-0b38dfa87440 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:52.706827 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b77b335-93e0-4382-8bd8-0b38dfa87440 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:52.707455 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b77b335-93e0-4382-8bd8-0b38dfa87440 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:52.708475 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b77b335-93e0-4382-8bd8-0b38dfa87440 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:52.821250 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7e0f1288-4f85-4c65-931d-3c2322a673a0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:52.831388 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7e0f1288-4f85-4c65-931d-3c2322a673a0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:52.833168 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7e0f1288-4f85-4c65-931d-3c2322a673a0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:52.834352 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7e0f1288-4f85-4c65-931d-3c2322a673a0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.184478 Sep 06 21:14:52.835134 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 107/205] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:52 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 21:14:52.879073 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3b77b335-93e0-4382-8bd8-0b38dfa87440 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:52.889440 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3b77b335-93e0-4382-8bd8-0b38dfa87440 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.203200 Sep 06 21:14:52.890370 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 99/206] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:52 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:14:53.241239 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5576a7eb-3d5c-4600-b1d2-a7b0f506e208 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:53.242242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5576a7eb-3d5c-4600-b1d2-a7b0f506e208 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:53.252337 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5576a7eb-3d5c-4600-b1d2-a7b0f506e208 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:53.253028 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5576a7eb-3d5c-4600-b1d2-a7b0f506e208 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:53.253844 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5576a7eb-3d5c-4600-b1d2-a7b0f506e208 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:53.254566 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5576a7eb-3d5c-4600-b1d2-a7b0f506e208 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:53.255008 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5576a7eb-3d5c-4600-b1d2-a7b0f506e208 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:53.255411 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5576a7eb-3d5c-4600-b1d2-a7b0f506e208 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:53.409997 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5576a7eb-3d5c-4600-b1d2-a7b0f506e208 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:53.418120 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5576a7eb-3d5c-4600-b1d2-a7b0f506e208 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.182741 Sep 06 21:14:53.418947 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 108/207] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:53 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:53.467157 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-971c52ae-30e2-4be8-88db-f7e4c8e3dc54 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:53.467756 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-971c52ae-30e2-4be8-88db-f7e4c8e3dc54 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:53.474865 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-971c52ae-30e2-4be8-88db-f7e4c8e3dc54 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:53.475947 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-971c52ae-30e2-4be8-88db-f7e4c8e3dc54 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:53.476536 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-971c52ae-30e2-4be8-88db-f7e4c8e3dc54 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:53.478017 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-971c52ae-30e2-4be8-88db-f7e4c8e3dc54 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:53.478567 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-971c52ae-30e2-4be8-88db-f7e4c8e3dc54 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:53.479165 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-971c52ae-30e2-4be8-88db-f7e4c8e3dc54 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:53.643739 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-971c52ae-30e2-4be8-88db-f7e4c8e3dc54 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:53.652102 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-971c52ae-30e2-4be8-88db-f7e4c8e3dc54 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.189338 Sep 06 21:14:53.652924 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 100/208] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:53 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:53.861364 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bfc8d4d6-7038-4460-9aa2-5d588569a1bc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:53.861835 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bfc8d4d6-7038-4460-9aa2-5d588569a1bc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:53.869164 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bfc8d4d6-7038-4460-9aa2-5d588569a1bc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:53.869651 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bfc8d4d6-7038-4460-9aa2-5d588569a1bc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:53.870084 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bfc8d4d6-7038-4460-9aa2-5d588569a1bc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:53.870783 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bfc8d4d6-7038-4460-9aa2-5d588569a1bc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:53.871223 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bfc8d4d6-7038-4460-9aa2-5d588569a1bc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:53.871621 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bfc8d4d6-7038-4460-9aa2-5d588569a1bc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:53.914092 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0a5c583d-74ee-465a-ba1a-cf150bd6c5bd tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:53.914700 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0a5c583d-74ee-465a-ba1a-cf150bd6c5bd tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:53.921114 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a5c583d-74ee-465a-ba1a-cf150bd6c5bd tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:53.921599 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a5c583d-74ee-465a-ba1a-cf150bd6c5bd tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:53.922016 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a5c583d-74ee-465a-ba1a-cf150bd6c5bd tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:53.922709 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a5c583d-74ee-465a-ba1a-cf150bd6c5bd tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:53.923151 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a5c583d-74ee-465a-ba1a-cf150bd6c5bd tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:53.923568 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a5c583d-74ee-465a-ba1a-cf150bd6c5bd tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:54.011583 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-bfc8d4d6-7038-4460-9aa2-5d588569a1bc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:54.022682 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-bfc8d4d6-7038-4460-9aa2-5d588569a1bc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:54.024128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-bfc8d4d6-7038-4460-9aa2-5d588569a1bc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:54.025210 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bfc8d4d6-7038-4460-9aa2-5d588569a1bc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.168152 Sep 06 21:14:54.025756 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 109/209] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:53 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:54.073903 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0a5c583d-74ee-465a-ba1a-cf150bd6c5bd tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:54.083833 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0a5c583d-74ee-465a-ba1a-cf150bd6c5bd tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.173554 Sep 06 21:14:54.084828 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 101/210] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:53 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:14:54.441977 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0dd95031-a2be-4f32-9586-cb93359e1ecf tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:54.442612 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0dd95031-a2be-4f32-9586-cb93359e1ecf tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:54.448980 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0dd95031-a2be-4f32-9586-cb93359e1ecf tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:54.449468 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0dd95031-a2be-4f32-9586-cb93359e1ecf tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:54.449899 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0dd95031-a2be-4f32-9586-cb93359e1ecf tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:54.450606 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0dd95031-a2be-4f32-9586-cb93359e1ecf tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:54.451051 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0dd95031-a2be-4f32-9586-cb93359e1ecf tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:54.451441 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0dd95031-a2be-4f32-9586-cb93359e1ecf tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:54.620062 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0dd95031-a2be-4f32-9586-cb93359e1ecf tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:54.628134 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0dd95031-a2be-4f32-9586-cb93359e1ecf tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.190181 Sep 06 21:14:54.628692 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 110/211] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:54 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:54.676143 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-675c86c7-bbb3-4777-8856-a3a05c96d849 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:54.676738 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-675c86c7-bbb3-4777-8856-a3a05c96d849 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:54.682914 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-675c86c7-bbb3-4777-8856-a3a05c96d849 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:54.683388 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-675c86c7-bbb3-4777-8856-a3a05c96d849 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:54.683785 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-675c86c7-bbb3-4777-8856-a3a05c96d849 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:54.684462 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-675c86c7-bbb3-4777-8856-a3a05c96d849 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:54.685004 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-675c86c7-bbb3-4777-8856-a3a05c96d849 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:54.685417 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-675c86c7-bbb3-4777-8856-a3a05c96d849 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:54.819193 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-675c86c7-bbb3-4777-8856-a3a05c96d849 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:54.827201 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-675c86c7-bbb3-4777-8856-a3a05c96d849 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.155304 Sep 06 21:14:54.827772 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 102/212] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:54 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:55.051421 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8580a6eb-1b13-40eb-baff-48a5acad5044 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:55.052268 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8580a6eb-1b13-40eb-baff-48a5acad5044 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:55.059276 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8580a6eb-1b13-40eb-baff-48a5acad5044 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:55.059843 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8580a6eb-1b13-40eb-baff-48a5acad5044 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:55.060278 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8580a6eb-1b13-40eb-baff-48a5acad5044 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:55.061018 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8580a6eb-1b13-40eb-baff-48a5acad5044 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:55.061464 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8580a6eb-1b13-40eb-baff-48a5acad5044 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:55.061882 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8580a6eb-1b13-40eb-baff-48a5acad5044 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:55.107823 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2bd5cae9-d830-4efd-a2de-fce5555b421e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:55.108606 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2bd5cae9-d830-4efd-a2de-fce5555b421e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:55.115369 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bd5cae9-d830-4efd-a2de-fce5555b421e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:55.115861 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bd5cae9-d830-4efd-a2de-fce5555b421e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:55.116481 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bd5cae9-d830-4efd-a2de-fce5555b421e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:55.117213 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bd5cae9-d830-4efd-a2de-fce5555b421e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:55.117655 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bd5cae9-d830-4efd-a2de-fce5555b421e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:55.118097 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bd5cae9-d830-4efd-a2de-fce5555b421e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:55.197411 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8580a6eb-1b13-40eb-baff-48a5acad5044 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:55.206893 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8580a6eb-1b13-40eb-baff-48a5acad5044 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:55.209200 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8580a6eb-1b13-40eb-baff-48a5acad5044 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:55.210440 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8580a6eb-1b13-40eb-baff-48a5acad5044 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.163740 Sep 06 21:14:55.221482 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 111/213] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:55 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:55.252877 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2bd5cae9-d830-4efd-a2de-fce5555b421e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:55.260850 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2bd5cae9-d830-4efd-a2de-fce5555b421e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.157373 Sep 06 21:14:55.261425 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 103/214] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:55 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:14:55.649709 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-670d4dd1-2c65-4ccb-9a5f-87c92de5605f tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:55.650392 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-670d4dd1-2c65-4ccb-9a5f-87c92de5605f tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:55.656784 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-670d4dd1-2c65-4ccb-9a5f-87c92de5605f tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:55.657267 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-670d4dd1-2c65-4ccb-9a5f-87c92de5605f tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:55.657694 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-670d4dd1-2c65-4ccb-9a5f-87c92de5605f tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:55.658379 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-670d4dd1-2c65-4ccb-9a5f-87c92de5605f tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:55.658818 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-670d4dd1-2c65-4ccb-9a5f-87c92de5605f tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:55.659265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-670d4dd1-2c65-4ccb-9a5f-87c92de5605f tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:55.793141 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-670d4dd1-2c65-4ccb-9a5f-87c92de5605f tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:55.801794 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-670d4dd1-2c65-4ccb-9a5f-87c92de5605f tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.155841 Sep 06 21:14:55.802365 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 112/215] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:55 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:55.850526 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c4d2c69f-9f63-407d-9c82-cbc6c218e925 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:55.851138 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c4d2c69f-9f63-407d-9c82-cbc6c218e925 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:55.857652 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4d2c69f-9f63-407d-9c82-cbc6c218e925 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:55.858127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4d2c69f-9f63-407d-9c82-cbc6c218e925 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:55.858554 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4d2c69f-9f63-407d-9c82-cbc6c218e925 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:55.859234 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4d2c69f-9f63-407d-9c82-cbc6c218e925 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:55.859673 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4d2c69f-9f63-407d-9c82-cbc6c218e925 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:55.860088 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4d2c69f-9f63-407d-9c82-cbc6c218e925 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:55.991530 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c4d2c69f-9f63-407d-9c82-cbc6c218e925 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:55.999534 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c4d2c69f-9f63-407d-9c82-cbc6c218e925 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.152941 Sep 06 21:14:56.000122 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 104/216] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:55 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:56.235510 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1b490c59-c5e0-427f-92ac-8229dc93d101 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:56.236201 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1b490c59-c5e0-427f-92ac-8229dc93d101 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:56.242614 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b490c59-c5e0-427f-92ac-8229dc93d101 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:56.243091 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b490c59-c5e0-427f-92ac-8229dc93d101 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:56.243512 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b490c59-c5e0-427f-92ac-8229dc93d101 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:56.244186 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b490c59-c5e0-427f-92ac-8229dc93d101 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:56.244680 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b490c59-c5e0-427f-92ac-8229dc93d101 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:56.245110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b490c59-c5e0-427f-92ac-8229dc93d101 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:56.285714 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-612cf750-c43a-4809-a9f3-d1c23a8d0f41 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:56.286641 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-612cf750-c43a-4809-a9f3-d1c23a8d0f41 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:56.296220 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-612cf750-c43a-4809-a9f3-d1c23a8d0f41 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:56.296726 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-612cf750-c43a-4809-a9f3-d1c23a8d0f41 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:56.297155 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-612cf750-c43a-4809-a9f3-d1c23a8d0f41 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:56.297850 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-612cf750-c43a-4809-a9f3-d1c23a8d0f41 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:56.298393 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-612cf750-c43a-4809-a9f3-d1c23a8d0f41 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:56.298840 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-612cf750-c43a-4809-a9f3-d1c23a8d0f41 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:56.416163 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1b490c59-c5e0-427f-92ac-8229dc93d101 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:56.426872 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1b490c59-c5e0-427f-92ac-8229dc93d101 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:56.428747 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1b490c59-c5e0-427f-92ac-8229dc93d101 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:56.429798 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1b490c59-c5e0-427f-92ac-8229dc93d101 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.198198 Sep 06 21:14:56.430428 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 113/217] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:56 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:56.461171 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-612cf750-c43a-4809-a9f3-d1c23a8d0f41 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:56.469363 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-612cf750-c43a-4809-a9f3-d1c23a8d0f41 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.188617 Sep 06 21:14:56.469934 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 105/218] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:56 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:14:56.825979 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2f8b8032-5a6b-49bf-81b4-9131ed9475c0 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:56.826943 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2f8b8032-5a6b-49bf-81b4-9131ed9475c0 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:56.833848 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f8b8032-5a6b-49bf-81b4-9131ed9475c0 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:56.834429 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f8b8032-5a6b-49bf-81b4-9131ed9475c0 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:56.834950 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f8b8032-5a6b-49bf-81b4-9131ed9475c0 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:56.835659 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f8b8032-5a6b-49bf-81b4-9131ed9475c0 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:56.836099 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f8b8032-5a6b-49bf-81b4-9131ed9475c0 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:56.836517 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f8b8032-5a6b-49bf-81b4-9131ed9475c0 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:56.974196 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2f8b8032-5a6b-49bf-81b4-9131ed9475c0 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:56.982390 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2f8b8032-5a6b-49bf-81b4-9131ed9475c0 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.161217 Sep 06 21:14:56.982960 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 114/219] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:56 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:57.021793 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0a387613-c7fc-42ec-8dec-244e16edb2e4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:57.022487 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0a387613-c7fc-42ec-8dec-244e16edb2e4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:57.029053 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a387613-c7fc-42ec-8dec-244e16edb2e4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:57.029527 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a387613-c7fc-42ec-8dec-244e16edb2e4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:57.029964 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a387613-c7fc-42ec-8dec-244e16edb2e4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:57.030655 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a387613-c7fc-42ec-8dec-244e16edb2e4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:57.031082 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a387613-c7fc-42ec-8dec-244e16edb2e4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:57.031496 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a387613-c7fc-42ec-8dec-244e16edb2e4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:57.236572 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0a387613-c7fc-42ec-8dec-244e16edb2e4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:57.244489 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0a387613-c7fc-42ec-8dec-244e16edb2e4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.226505 Sep 06 21:14:57.245166 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 106/220] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:57 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:57.457172 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-07e68c91-6345-450b-8fde-02cf2703b128 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:57.458058 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-07e68c91-6345-450b-8fde-02cf2703b128 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:57.465533 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07e68c91-6345-450b-8fde-02cf2703b128 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:57.466265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07e68c91-6345-450b-8fde-02cf2703b128 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:57.466686 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07e68c91-6345-450b-8fde-02cf2703b128 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:57.467382 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07e68c91-6345-450b-8fde-02cf2703b128 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:57.467818 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07e68c91-6345-450b-8fde-02cf2703b128 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:57.468224 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07e68c91-6345-450b-8fde-02cf2703b128 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:57.493157 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4bf0001a-a0c0-4706-8e35-6d8025eb1c30 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:57.493375 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:57.494117 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4bf0001a-a0c0-4706-8e35-6d8025eb1c30 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:57.502830 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bf0001a-a0c0-4706-8e35-6d8025eb1c30 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:57.503564 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bf0001a-a0c0-4706-8e35-6d8025eb1c30 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:57.504152 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bf0001a-a0c0-4706-8e35-6d8025eb1c30 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:57.504881 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bf0001a-a0c0-4706-8e35-6d8025eb1c30 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:57.505492 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bf0001a-a0c0-4706-8e35-6d8025eb1c30 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:57.505896 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bf0001a-a0c0-4706-8e35-6d8025eb1c30 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:57.646504 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-07e68c91-6345-450b-8fde-02cf2703b128 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:57.659045 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-07e68c91-6345-450b-8fde-02cf2703b128 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:57.661076 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-07e68c91-6345-450b-8fde-02cf2703b128 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:57.662569 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-07e68c91-6345-450b-8fde-02cf2703b128 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.209588 Sep 06 21:14:57.663538 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 115/221] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:57 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:57.671816 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4bf0001a-a0c0-4706-8e35-6d8025eb1c30 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:57.687317 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4bf0001a-a0c0-4706-8e35-6d8025eb1c30 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.198141 Sep 06 21:14:57.704083 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 107/222] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:57 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:14:58.005952 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0a47ff25-677c-44e6-aead-c5373699e086 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:58.006508 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0a47ff25-677c-44e6-aead-c5373699e086 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:58.013895 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a47ff25-677c-44e6-aead-c5373699e086 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:58.014677 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a47ff25-677c-44e6-aead-c5373699e086 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:58.015313 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a47ff25-677c-44e6-aead-c5373699e086 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:58.016023 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a47ff25-677c-44e6-aead-c5373699e086 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:58.016467 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a47ff25-677c-44e6-aead-c5373699e086 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:58.016919 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a47ff25-677c-44e6-aead-c5373699e086 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:58.177473 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0a47ff25-677c-44e6-aead-c5373699e086 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:58.183086 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0a47ff25-677c-44e6-aead-c5373699e086 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.181277 Sep 06 21:14:58.183754 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 116/223] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:58 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:58.268563 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-405f95e2-fb56-4066-bfdb-079f0795d2bc tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:58.269196 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-405f95e2-fb56-4066-bfdb-079f0795d2bc tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:58.276059 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-405f95e2-fb56-4066-bfdb-079f0795d2bc tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:58.276599 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-405f95e2-fb56-4066-bfdb-079f0795d2bc tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:58.277082 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-405f95e2-fb56-4066-bfdb-079f0795d2bc tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:58.277797 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-405f95e2-fb56-4066-bfdb-079f0795d2bc tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:58.278435 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-405f95e2-fb56-4066-bfdb-079f0795d2bc tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:58.278855 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-405f95e2-fb56-4066-bfdb-079f0795d2bc tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:58.447393 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-405f95e2-fb56-4066-bfdb-079f0795d2bc tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:58.451921 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:58.457646 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-405f95e2-fb56-4066-bfdb-079f0795d2bc tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.194165 Sep 06 21:14:58.458391 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 108/224] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:58 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:58.691704 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ba45ede9-f51f-4070-ae9c-c53ca990e9fe tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:58.692847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ba45ede9-f51f-4070-ae9c-c53ca990e9fe tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:58.699370 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba45ede9-f51f-4070-ae9c-c53ca990e9fe tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:58.700103 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba45ede9-f51f-4070-ae9c-c53ca990e9fe tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:58.700613 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba45ede9-f51f-4070-ae9c-c53ca990e9fe tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:58.701385 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba45ede9-f51f-4070-ae9c-c53ca990e9fe tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:58.701891 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba45ede9-f51f-4070-ae9c-c53ca990e9fe tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:58.702523 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba45ede9-f51f-4070-ae9c-c53ca990e9fe tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:58.712492 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-313bd08d-de58-4085-95f5-ddf4fd83ea18 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:58.713128 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-313bd08d-de58-4085-95f5-ddf4fd83ea18 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:58.719866 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-313bd08d-de58-4085-95f5-ddf4fd83ea18 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:58.720351 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-313bd08d-de58-4085-95f5-ddf4fd83ea18 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:58.720915 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-313bd08d-de58-4085-95f5-ddf4fd83ea18 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:58.721697 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-313bd08d-de58-4085-95f5-ddf4fd83ea18 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:58.722137 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-313bd08d-de58-4085-95f5-ddf4fd83ea18 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:58.722582 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-313bd08d-de58-4085-95f5-ddf4fd83ea18 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:58.877862 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ba45ede9-f51f-4070-ae9c-c53ca990e9fe tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:58.880514 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-313bd08d-de58-4085-95f5-ddf4fd83ea18 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:58.888500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-313bd08d-de58-4085-95f5-ddf4fd83ea18 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.180937 Sep 06 21:14:58.889111 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 109/225] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:58 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:14:58.892031 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ba45ede9-f51f-4070-ae9c-c53ca990e9fe tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:58.893937 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ba45ede9-f51f-4070-ae9c-c53ca990e9fe tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:58.895240 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ba45ede9-f51f-4070-ae9c-c53ca990e9fe tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.207729 Sep 06 21:14:58.896367 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 117/226] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:58 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:14:59.207012 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-38ab67d2-b7fe-4f65-aabf-46cb9e8c67ea tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:59.207723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-38ab67d2-b7fe-4f65-aabf-46cb9e8c67ea tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:59.213914 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38ab67d2-b7fe-4f65-aabf-46cb9e8c67ea tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:59.214459 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38ab67d2-b7fe-4f65-aabf-46cb9e8c67ea tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:59.214976 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38ab67d2-b7fe-4f65-aabf-46cb9e8c67ea tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:59.215908 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38ab67d2-b7fe-4f65-aabf-46cb9e8c67ea tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:59.216386 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38ab67d2-b7fe-4f65-aabf-46cb9e8c67ea tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:59.216947 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38ab67d2-b7fe-4f65-aabf-46cb9e8c67ea tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:59.394556 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-38ab67d2-b7fe-4f65-aabf-46cb9e8c67ea tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:59.408325 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-38ab67d2-b7fe-4f65-aabf-46cb9e8c67ea tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.205296 Sep 06 21:14:59.410041 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 110/227] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:59 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:59.480256 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-60a7c68b-013f-4f33-b670-5dcdea5f3b19 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:59.480938 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-60a7c68b-013f-4f33-b670-5dcdea5f3b19 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:59.486897 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60a7c68b-013f-4f33-b670-5dcdea5f3b19 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:59.487568 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60a7c68b-013f-4f33-b670-5dcdea5f3b19 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:59.488252 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60a7c68b-013f-4f33-b670-5dcdea5f3b19 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:59.489013 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60a7c68b-013f-4f33-b670-5dcdea5f3b19 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:59.489466 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60a7c68b-013f-4f33-b670-5dcdea5f3b19 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:59.489880 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60a7c68b-013f-4f33-b670-5dcdea5f3b19 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:59.629794 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-60a7c68b-013f-4f33-b670-5dcdea5f3b19 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:14:59.637553 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-60a7c68b-013f-4f33-b670-5dcdea5f3b19 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.161191 Sep 06 21:14:59.638119 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 118/228] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:59 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:14:59.913866 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a8366701-2294-4263-be58-2e4f354a2b23 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:59.915119 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a8366701-2294-4263-be58-2e4f354a2b23 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:59.921932 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d14d44d0-70f4-47ca-8d08-d556d50acb38 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:14:59.922082 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8366701-2294-4263-be58-2e4f354a2b23 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:59.922521 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8366701-2294-4263-be58-2e4f354a2b23 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:59.922878 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d14d44d0-70f4-47ca-8d08-d556d50acb38 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:14:59.923079 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8366701-2294-4263-be58-2e4f354a2b23 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:59.923974 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8366701-2294-4263-be58-2e4f354a2b23 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:59.924799 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8366701-2294-4263-be58-2e4f354a2b23 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:59.925365 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8366701-2294-4263-be58-2e4f354a2b23 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:59.930192 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d14d44d0-70f4-47ca-8d08-d556d50acb38 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:59.930672 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d14d44d0-70f4-47ca-8d08-d556d50acb38 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:59.931276 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d14d44d0-70f4-47ca-8d08-d556d50acb38 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:14:59.932300 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d14d44d0-70f4-47ca-8d08-d556d50acb38 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:14:59.932923 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d14d44d0-70f4-47ca-8d08-d556d50acb38 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:14:59.933357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d14d44d0-70f4-47ca-8d08-d556d50acb38 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:00.078399 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a8366701-2294-4263-be58-2e4f354a2b23 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:00.088345 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a8366701-2294-4263-be58-2e4f354a2b23 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.178632 Sep 06 21:15:00.089716 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 111/229] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:14:59 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:00.096577 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d14d44d0-70f4-47ca-8d08-d556d50acb38 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:00.105071 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d14d44d0-70f4-47ca-8d08-d556d50acb38 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:00.107227 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d14d44d0-70f4-47ca-8d08-d556d50acb38 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:00.108333 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d14d44d0-70f4-47ca-8d08-d556d50acb38 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.190922 Sep 06 21:15:00.108936 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 119/230] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:14:59 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:15:00.432771 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f3a99581-9c2d-4013-b004-f0a8e958d7d2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:00.433463 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f3a99581-9c2d-4013-b004-f0a8e958d7d2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:00.440005 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3a99581-9c2d-4013-b004-f0a8e958d7d2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:00.440619 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3a99581-9c2d-4013-b004-f0a8e958d7d2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:00.441136 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3a99581-9c2d-4013-b004-f0a8e958d7d2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:00.441979 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3a99581-9c2d-4013-b004-f0a8e958d7d2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:00.442421 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3a99581-9c2d-4013-b004-f0a8e958d7d2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:00.442969 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3a99581-9c2d-4013-b004-f0a8e958d7d2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:00.581375 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f3a99581-9c2d-4013-b004-f0a8e958d7d2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:00.589331 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f3a99581-9c2d-4013-b004-f0a8e958d7d2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.160511 Sep 06 21:15:00.598707 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 112/231] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:00 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:00.663476 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-06686ae7-3f3c-49b9-bec3-f08628d6c535 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:00.664490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-06686ae7-3f3c-49b9-bec3-f08628d6c535 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:00.673326 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06686ae7-3f3c-49b9-bec3-f08628d6c535 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:00.673963 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06686ae7-3f3c-49b9-bec3-f08628d6c535 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:00.674750 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06686ae7-3f3c-49b9-bec3-f08628d6c535 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:00.675668 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06686ae7-3f3c-49b9-bec3-f08628d6c535 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:00.676272 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06686ae7-3f3c-49b9-bec3-f08628d6c535 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:00.677100 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-06686ae7-3f3c-49b9-bec3-f08628d6c535 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:00.819934 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-06686ae7-3f3c-49b9-bec3-f08628d6c535 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:00.832215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-06686ae7-3f3c-49b9-bec3-f08628d6c535 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.174961 Sep 06 21:15:00.832938 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 120/232] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:00 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:01.111744 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3f53d9d3-0479-498f-b5e1-3b01f62c6f58 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:01.112347 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3f53d9d3-0479-498f-b5e1-3b01f62c6f58 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:01.118598 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f53d9d3-0479-498f-b5e1-3b01f62c6f58 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:01.119075 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f53d9d3-0479-498f-b5e1-3b01f62c6f58 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:01.119504 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f53d9d3-0479-498f-b5e1-3b01f62c6f58 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:01.120248 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f53d9d3-0479-498f-b5e1-3b01f62c6f58 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:01.120756 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f53d9d3-0479-498f-b5e1-3b01f62c6f58 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:01.121194 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f53d9d3-0479-498f-b5e1-3b01f62c6f58 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:01.133880 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d367870e-414b-4578-87e3-a069a9b76d24 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:01.134516 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d367870e-414b-4578-87e3-a069a9b76d24 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:01.143376 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d367870e-414b-4578-87e3-a069a9b76d24 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:01.143376 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d367870e-414b-4578-87e3-a069a9b76d24 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:01.143376 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d367870e-414b-4578-87e3-a069a9b76d24 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:01.143376 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d367870e-414b-4578-87e3-a069a9b76d24 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:01.143843 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d367870e-414b-4578-87e3-a069a9b76d24 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:01.144212 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d367870e-414b-4578-87e3-a069a9b76d24 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:01.294065 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3f53d9d3-0479-498f-b5e1-3b01f62c6f58 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:01.302834 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3f53d9d3-0479-498f-b5e1-3b01f62c6f58 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.195113 Sep 06 21:15:01.317214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 113/233] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:01 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:01.317522 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d367870e-414b-4578-87e3-a069a9b76d24 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:01.323673 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d367870e-414b-4578-87e3-a069a9b76d24 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:01.325143 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d367870e-414b-4578-87e3-a069a9b76d24 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:01.326239 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d367870e-414b-4578-87e3-a069a9b76d24 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.196624 Sep 06 21:15:01.326798 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 121/234] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:15:01 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 21:15:01.619784 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-511c8d0c-16c8-4027-85b6-08e7b3340955 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:01.620355 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-511c8d0c-16c8-4027-85b6-08e7b3340955 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:01.626991 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-511c8d0c-16c8-4027-85b6-08e7b3340955 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:01.627468 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-511c8d0c-16c8-4027-85b6-08e7b3340955 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:01.627922 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-511c8d0c-16c8-4027-85b6-08e7b3340955 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:01.628620 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-511c8d0c-16c8-4027-85b6-08e7b3340955 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:01.629118 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-511c8d0c-16c8-4027-85b6-08e7b3340955 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:01.629535 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-511c8d0c-16c8-4027-85b6-08e7b3340955 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:01.757598 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-511c8d0c-16c8-4027-85b6-08e7b3340955 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:01.765548 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-511c8d0c-16c8-4027-85b6-08e7b3340955 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.149676 Sep 06 21:15:01.766082 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 114/235] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:01 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:01.855398 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a6bb6ede-5185-414b-bfb5-578ea394fe0e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:01.856001 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a6bb6ede-5185-414b-bfb5-578ea394fe0e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:01.862762 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6bb6ede-5185-414b-bfb5-578ea394fe0e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:01.863354 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6bb6ede-5185-414b-bfb5-578ea394fe0e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:01.863779 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6bb6ede-5185-414b-bfb5-578ea394fe0e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:01.864472 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6bb6ede-5185-414b-bfb5-578ea394fe0e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:01.864943 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6bb6ede-5185-414b-bfb5-578ea394fe0e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:01.865359 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6bb6ede-5185-414b-bfb5-578ea394fe0e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:01.997344 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a6bb6ede-5185-414b-bfb5-578ea394fe0e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:02.005411 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a6bb6ede-5185-414b-bfb5-578ea394fe0e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.153911 Sep 06 21:15:02.006015 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 122/236] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:01 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:02.325740 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f6a6d89d-ff6d-4888-9f81-1cd3c583cf49 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:02.326339 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f6a6d89d-ff6d-4888-9f81-1cd3c583cf49 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:02.332689 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6a6d89d-ff6d-4888-9f81-1cd3c583cf49 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:02.333464 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6a6d89d-ff6d-4888-9f81-1cd3c583cf49 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:02.333896 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6a6d89d-ff6d-4888-9f81-1cd3c583cf49 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:02.334768 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6a6d89d-ff6d-4888-9f81-1cd3c583cf49 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:02.335263 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6a6d89d-ff6d-4888-9f81-1cd3c583cf49 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:02.335608 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6a6d89d-ff6d-4888-9f81-1cd3c583cf49 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:02.351920 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e2a5efef-d758-4900-9490-a5f21f61f13a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:02.352811 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e2a5efef-d758-4900-9490-a5f21f61f13a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:02.360986 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e2a5efef-d758-4900-9490-a5f21f61f13a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:02.361567 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e2a5efef-d758-4900-9490-a5f21f61f13a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:02.362116 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e2a5efef-d758-4900-9490-a5f21f61f13a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:02.363072 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e2a5efef-d758-4900-9490-a5f21f61f13a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:02.364069 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e2a5efef-d758-4900-9490-a5f21f61f13a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:02.364598 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e2a5efef-d758-4900-9490-a5f21f61f13a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:02.473579 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f6a6d89d-ff6d-4888-9f81-1cd3c583cf49 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:02.481965 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f6a6d89d-ff6d-4888-9f81-1cd3c583cf49 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.159968 Sep 06 21:15:02.482506 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 115/237] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:02 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:02.498960 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e2a5efef-d758-4900-9490-a5f21f61f13a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:02.507586 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e2a5efef-d758-4900-9490-a5f21f61f13a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:02.509054 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e2a5efef-d758-4900-9490-a5f21f61f13a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:02.510163 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e2a5efef-d758-4900-9490-a5f21f61f13a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.162434 Sep 06 21:15:02.510728 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 123/238] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:15:02 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:15:02.788822 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8c75df35-cc1b-48d1-a6d5-078845c12a89 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:02.789384 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8c75df35-cc1b-48d1-a6d5-078845c12a89 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:02.795823 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c75df35-cc1b-48d1-a6d5-078845c12a89 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:02.796294 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c75df35-cc1b-48d1-a6d5-078845c12a89 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:02.796715 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c75df35-cc1b-48d1-a6d5-078845c12a89 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:02.797418 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c75df35-cc1b-48d1-a6d5-078845c12a89 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:02.797852 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c75df35-cc1b-48d1-a6d5-078845c12a89 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:02.798269 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c75df35-cc1b-48d1-a6d5-078845c12a89 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:02.930018 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8c75df35-cc1b-48d1-a6d5-078845c12a89 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:02.938015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8c75df35-cc1b-48d1-a6d5-078845c12a89 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.153162 Sep 06 21:15:02.938611 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 116/239] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:02 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:03.028583 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d10e683b-2318-4117-b152-0a874f80de07 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:03.029227 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d10e683b-2318-4117-b152-0a874f80de07 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:03.035709 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d10e683b-2318-4117-b152-0a874f80de07 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:03.036193 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d10e683b-2318-4117-b152-0a874f80de07 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:03.036622 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d10e683b-2318-4117-b152-0a874f80de07 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:03.037350 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d10e683b-2318-4117-b152-0a874f80de07 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:03.037801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d10e683b-2318-4117-b152-0a874f80de07 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:03.038222 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d10e683b-2318-4117-b152-0a874f80de07 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:03.165708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d10e683b-2318-4117-b152-0a874f80de07 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:03.174224 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d10e683b-2318-4117-b152-0a874f80de07 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.149409 Sep 06 21:15:03.175173 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 124/240] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:03 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:03.507691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c7c49b7e-cd2e-4f1e-82ee-80cd3bef8c72 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:03.508559 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c7c49b7e-cd2e-4f1e-82ee-80cd3bef8c72 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:03.517471 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7c49b7e-cd2e-4f1e-82ee-80cd3bef8c72 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:03.518092 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7c49b7e-cd2e-4f1e-82ee-80cd3bef8c72 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:03.518689 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7c49b7e-cd2e-4f1e-82ee-80cd3bef8c72 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:03.519518 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7c49b7e-cd2e-4f1e-82ee-80cd3bef8c72 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:03.519959 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7c49b7e-cd2e-4f1e-82ee-80cd3bef8c72 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:03.520372 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7c49b7e-cd2e-4f1e-82ee-80cd3bef8c72 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:03.534975 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-361c32cd-e693-46ed-a6ca-ddf1a6f7abe8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:03.535580 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-361c32cd-e693-46ed-a6ca-ddf1a6f7abe8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:03.542110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-361c32cd-e693-46ed-a6ca-ddf1a6f7abe8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:03.542593 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-361c32cd-e693-46ed-a6ca-ddf1a6f7abe8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:03.543022 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-361c32cd-e693-46ed-a6ca-ddf1a6f7abe8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:03.543816 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-361c32cd-e693-46ed-a6ca-ddf1a6f7abe8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:03.544273 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-361c32cd-e693-46ed-a6ca-ddf1a6f7abe8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:03.544693 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-361c32cd-e693-46ed-a6ca-ddf1a6f7abe8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:03.662132 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c7c49b7e-cd2e-4f1e-82ee-80cd3bef8c72 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:03.670186 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c7c49b7e-cd2e-4f1e-82ee-80cd3bef8c72 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.169040 Sep 06 21:15:03.670934 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 117/241] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:03 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:03.684777 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-361c32cd-e693-46ed-a6ca-ddf1a6f7abe8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:03.694935 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-361c32cd-e693-46ed-a6ca-ddf1a6f7abe8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:03.696377 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-361c32cd-e693-46ed-a6ca-ddf1a6f7abe8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:03.697513 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-361c32cd-e693-46ed-a6ca-ddf1a6f7abe8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.166480 Sep 06 21:15:03.698087 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 125/242] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:15:03 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:15:03.961210 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7ec5259a-f9d4-42c6-aefc-4d7ad593e924 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:03.961854 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7ec5259a-f9d4-42c6-aefc-4d7ad593e924 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:03.968366 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ec5259a-f9d4-42c6-aefc-4d7ad593e924 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:03.968876 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ec5259a-f9d4-42c6-aefc-4d7ad593e924 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:03.969292 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ec5259a-f9d4-42c6-aefc-4d7ad593e924 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:03.969982 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ec5259a-f9d4-42c6-aefc-4d7ad593e924 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:03.970415 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ec5259a-f9d4-42c6-aefc-4d7ad593e924 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:03.970889 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ec5259a-f9d4-42c6-aefc-4d7ad593e924 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:04.105459 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7ec5259a-f9d4-42c6-aefc-4d7ad593e924 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:04.113622 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7ec5259a-f9d4-42c6-aefc-4d7ad593e924 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.156305 Sep 06 21:15:04.114193 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 118/243] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:03 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:04.198926 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c81dc4ac-a840-463d-9475-e7c995f6ea47 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:04.199458 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c81dc4ac-a840-463d-9475-e7c995f6ea47 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:04.207985 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c81dc4ac-a840-463d-9475-e7c995f6ea47 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:04.208423 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c81dc4ac-a840-463d-9475-e7c995f6ea47 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:04.208911 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c81dc4ac-a840-463d-9475-e7c995f6ea47 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:04.209576 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c81dc4ac-a840-463d-9475-e7c995f6ea47 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:04.210019 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c81dc4ac-a840-463d-9475-e7c995f6ea47 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:04.210421 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c81dc4ac-a840-463d-9475-e7c995f6ea47 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:04.355827 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c81dc4ac-a840-463d-9475-e7c995f6ea47 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:04.364180 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c81dc4ac-a840-463d-9475-e7c995f6ea47 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.169360 Sep 06 21:15:04.364774 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 126/244] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:04 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:04.694271 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-051836d0-d91d-4cbe-8922-891cf903dc5d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:04.694955 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-051836d0-d91d-4cbe-8922-891cf903dc5d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:04.701624 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-051836d0-d91d-4cbe-8922-891cf903dc5d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:04.702134 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-051836d0-d91d-4cbe-8922-891cf903dc5d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:04.702796 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-051836d0-d91d-4cbe-8922-891cf903dc5d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:04.703513 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-051836d0-d91d-4cbe-8922-891cf903dc5d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:04.704142 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-051836d0-d91d-4cbe-8922-891cf903dc5d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:04.704549 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-051836d0-d91d-4cbe-8922-891cf903dc5d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:04.733134 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-42624d90-044c-45e3-adda-cf79b10761f8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:04.733134 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-42624d90-044c-45e3-adda-cf79b10761f8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:04.733134 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-42624d90-044c-45e3-adda-cf79b10761f8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:04.733134 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-42624d90-044c-45e3-adda-cf79b10761f8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:04.733468 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-42624d90-044c-45e3-adda-cf79b10761f8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:04.733468 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-42624d90-044c-45e3-adda-cf79b10761f8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:04.733468 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-42624d90-044c-45e3-adda-cf79b10761f8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:04.733468 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-42624d90-044c-45e3-adda-cf79b10761f8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:04.854265 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-051836d0-d91d-4cbe-8922-891cf903dc5d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:04.864462 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-051836d0-d91d-4cbe-8922-891cf903dc5d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.174238 Sep 06 21:15:04.865108 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 119/245] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:04 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:04.913020 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-42624d90-044c-45e3-adda-cf79b10761f8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:04.921355 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-42624d90-044c-45e3-adda-cf79b10761f8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:04.922784 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-42624d90-044c-45e3-adda-cf79b10761f8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:04.923882 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-42624d90-044c-45e3-adda-cf79b10761f8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.205059 Sep 06 21:15:04.924825 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 127/246] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:15:04 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:15:05.138114 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-72a9a546-42f4-4d73-a9c1-243248dee325 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:05.138114 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-72a9a546-42f4-4d73-a9c1-243248dee325 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:05.144578 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72a9a546-42f4-4d73-a9c1-243248dee325 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:05.145371 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72a9a546-42f4-4d73-a9c1-243248dee325 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:05.145817 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72a9a546-42f4-4d73-a9c1-243248dee325 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:05.146723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72a9a546-42f4-4d73-a9c1-243248dee325 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:05.147221 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72a9a546-42f4-4d73-a9c1-243248dee325 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:05.147694 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72a9a546-42f4-4d73-a9c1-243248dee325 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:05.318740 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-72a9a546-42f4-4d73-a9c1-243248dee325 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:05.328594 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-72a9a546-42f4-4d73-a9c1-243248dee325 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.196009 Sep 06 21:15:05.332704 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 120/247] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:05 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:05.391265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4e8c415e-5def-4635-98ef-a76b52c1cf9f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:05.392286 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4e8c415e-5def-4635-98ef-a76b52c1cf9f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:05.400760 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e8c415e-5def-4635-98ef-a76b52c1cf9f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:05.401240 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e8c415e-5def-4635-98ef-a76b52c1cf9f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:05.401722 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e8c415e-5def-4635-98ef-a76b52c1cf9f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:05.403063 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e8c415e-5def-4635-98ef-a76b52c1cf9f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:05.403751 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e8c415e-5def-4635-98ef-a76b52c1cf9f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:05.404411 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e8c415e-5def-4635-98ef-a76b52c1cf9f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:05.556409 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4e8c415e-5def-4635-98ef-a76b52c1cf9f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:05.565296 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4e8c415e-5def-4635-98ef-a76b52c1cf9f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.179294 Sep 06 21:15:05.565811 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 128/248] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:05 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:05.887763 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1333b1ff-aee3-4d66-8808-a78db0790687 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:05.888360 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1333b1ff-aee3-4d66-8808-a78db0790687 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:05.896532 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1333b1ff-aee3-4d66-8808-a78db0790687 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:05.897236 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1333b1ff-aee3-4d66-8808-a78db0790687 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:05.897869 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1333b1ff-aee3-4d66-8808-a78db0790687 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:05.898768 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1333b1ff-aee3-4d66-8808-a78db0790687 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:05.899191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1333b1ff-aee3-4d66-8808-a78db0790687 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:05.899760 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1333b1ff-aee3-4d66-8808-a78db0790687 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:05.953386 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1cd84d85-a90a-4874-ab2a-3216cc0bfea8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:05.954936 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1cd84d85-a90a-4874-ab2a-3216cc0bfea8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:05.963890 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1cd84d85-a90a-4874-ab2a-3216cc0bfea8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:05.965086 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1cd84d85-a90a-4874-ab2a-3216cc0bfea8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:05.966055 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1cd84d85-a90a-4874-ab2a-3216cc0bfea8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:05.967634 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1cd84d85-a90a-4874-ab2a-3216cc0bfea8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:05.968494 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1cd84d85-a90a-4874-ab2a-3216cc0bfea8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:05.969196 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1cd84d85-a90a-4874-ab2a-3216cc0bfea8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:06.066046 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1333b1ff-aee3-4d66-8808-a78db0790687 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:06.082839 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1333b1ff-aee3-4d66-8808-a78db0790687 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.199090 Sep 06 21:15:06.088826 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 121/249] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:05 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:06.134958 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1cd84d85-a90a-4874-ab2a-3216cc0bfea8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:06.143517 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1cd84d85-a90a-4874-ab2a-3216cc0bfea8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:06.145127 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1cd84d85-a90a-4874-ab2a-3216cc0bfea8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:06.146520 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1cd84d85-a90a-4874-ab2a-3216cc0bfea8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.200252 Sep 06 21:15:06.147038 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 129/250] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:15:05 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:15:06.362748 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a1216fa2-9850-4dd3-8fb7-5071b820ff71 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:06.363791 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a1216fa2-9850-4dd3-8fb7-5071b820ff71 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:06.378156 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1216fa2-9850-4dd3-8fb7-5071b820ff71 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:06.382080 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1216fa2-9850-4dd3-8fb7-5071b820ff71 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:06.382797 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1216fa2-9850-4dd3-8fb7-5071b820ff71 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:06.384019 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1216fa2-9850-4dd3-8fb7-5071b820ff71 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:06.384837 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1216fa2-9850-4dd3-8fb7-5071b820ff71 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:06.385849 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1216fa2-9850-4dd3-8fb7-5071b820ff71 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:06.590670 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0edda26d-30ad-447c-8560-5654c3c7bb74 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:06.593227 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0edda26d-30ad-447c-8560-5654c3c7bb74 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:06.609465 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0edda26d-30ad-447c-8560-5654c3c7bb74 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:06.610151 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0edda26d-30ad-447c-8560-5654c3c7bb74 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:06.610719 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0edda26d-30ad-447c-8560-5654c3c7bb74 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:06.611298 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a1216fa2-9850-4dd3-8fb7-5071b820ff71 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:06.611893 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0edda26d-30ad-447c-8560-5654c3c7bb74 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:06.612474 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0edda26d-30ad-447c-8560-5654c3c7bb74 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:06.613329 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0edda26d-30ad-447c-8560-5654c3c7bb74 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:06.621242 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a1216fa2-9850-4dd3-8fb7-5071b820ff71 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.270365 Sep 06 21:15:06.637096 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 122/251] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:06 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:06.799015 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0edda26d-30ad-447c-8560-5654c3c7bb74 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:06.807581 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0edda26d-30ad-447c-8560-5654c3c7bb74 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.222776 Sep 06 21:15:06.808139 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 130/252] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:06 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:07.109644 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-deecdfa9-f439-4921-8e79-3f89cb9ce8ea tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:07.111132 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-deecdfa9-f439-4921-8e79-3f89cb9ce8ea tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:07.119183 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-deecdfa9-f439-4921-8e79-3f89cb9ce8ea tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:07.119695 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-deecdfa9-f439-4921-8e79-3f89cb9ce8ea tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:07.120096 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-deecdfa9-f439-4921-8e79-3f89cb9ce8ea tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:07.120832 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-deecdfa9-f439-4921-8e79-3f89cb9ce8ea tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:07.121286 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-deecdfa9-f439-4921-8e79-3f89cb9ce8ea tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:07.121699 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-deecdfa9-f439-4921-8e79-3f89cb9ce8ea tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:07.176399 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-71b0904e-0274-44d6-a28a-73208a6ce5f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:07.177459 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-71b0904e-0274-44d6-a28a-73208a6ce5f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:07.184689 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71b0904e-0274-44d6-a28a-73208a6ce5f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:07.185454 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71b0904e-0274-44d6-a28a-73208a6ce5f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:07.186102 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71b0904e-0274-44d6-a28a-73208a6ce5f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:07.186922 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71b0904e-0274-44d6-a28a-73208a6ce5f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:07.187585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71b0904e-0274-44d6-a28a-73208a6ce5f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:07.188062 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71b0904e-0274-44d6-a28a-73208a6ce5f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:07.371680 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-deecdfa9-f439-4921-8e79-3f89cb9ce8ea tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:07.386308 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-deecdfa9-f439-4921-8e79-3f89cb9ce8ea tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.280601 Sep 06 21:15:07.388532 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 123/253] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:07 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:07.403949 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-71b0904e-0274-44d6-a28a-73208a6ce5f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:07.419788 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-71b0904e-0274-44d6-a28a-73208a6ce5f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:07.421736 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-71b0904e-0274-44d6-a28a-73208a6ce5f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:07.423386 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-71b0904e-0274-44d6-a28a-73208a6ce5f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.251719 Sep 06 21:15:07.424893 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 131/254] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:15:07 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:15:07.644548 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1ea33732-0a76-4655-ac31-fb0331dfb79a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:07.645583 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1ea33732-0a76-4655-ac31-fb0331dfb79a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:07.654853 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ea33732-0a76-4655-ac31-fb0331dfb79a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:07.655645 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ea33732-0a76-4655-ac31-fb0331dfb79a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:07.656690 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ea33732-0a76-4655-ac31-fb0331dfb79a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:07.657850 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ea33732-0a76-4655-ac31-fb0331dfb79a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:07.658493 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ea33732-0a76-4655-ac31-fb0331dfb79a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:07.659030 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ea33732-0a76-4655-ac31-fb0331dfb79a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:07.837512 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-17ab231b-d4c5-4b98-81d4-56a149694a77 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:07.838313 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-17ab231b-d4c5-4b98-81d4-56a149694a77 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:07.847531 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17ab231b-d4c5-4b98-81d4-56a149694a77 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:07.848187 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17ab231b-d4c5-4b98-81d4-56a149694a77 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:07.848843 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17ab231b-d4c5-4b98-81d4-56a149694a77 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:07.850123 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17ab231b-d4c5-4b98-81d4-56a149694a77 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:07.851087 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17ab231b-d4c5-4b98-81d4-56a149694a77 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:07.851895 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17ab231b-d4c5-4b98-81d4-56a149694a77 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:07.855554 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1ea33732-0a76-4655-ac31-fb0331dfb79a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:07.867740 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1ea33732-0a76-4655-ac31-fb0331dfb79a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.227331 Sep 06 21:15:07.868494 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 124/255] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:07 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:07.881238 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:08.024188 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-17ab231b-d4c5-4b98-81d4-56a149694a77 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:08.032692 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-17ab231b-d4c5-4b98-81d4-56a149694a77 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.204685 Sep 06 21:15:08.033262 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 132/256] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:07 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:15:08.413327 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d9f09803-f71a-4993-ac29-a6452f120849 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:08.413900 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d9f09803-f71a-4993-ac29-a6452f120849 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:08.420253 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d9f09803-f71a-4993-ac29-a6452f120849 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:08.420757 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d9f09803-f71a-4993-ac29-a6452f120849 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:08.421184 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d9f09803-f71a-4993-ac29-a6452f120849 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:08.421868 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d9f09803-f71a-4993-ac29-a6452f120849 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:08.422305 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d9f09803-f71a-4993-ac29-a6452f120849 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:08.422719 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d9f09803-f71a-4993-ac29-a6452f120849 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:08.452220 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:08.452585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4dcad6c3-d689-467a-adb0-da6f758a26b2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:08.453692 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4dcad6c3-d689-467a-adb0-da6f758a26b2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:08.461183 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4dcad6c3-d689-467a-adb0-da6f758a26b2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:08.461840 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4dcad6c3-d689-467a-adb0-da6f758a26b2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:08.462434 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4dcad6c3-d689-467a-adb0-da6f758a26b2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:08.463502 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4dcad6c3-d689-467a-adb0-da6f758a26b2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:08.464107 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4dcad6c3-d689-467a-adb0-da6f758a26b2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:08.464907 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4dcad6c3-d689-467a-adb0-da6f758a26b2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:08.593444 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d9f09803-f71a-4993-ac29-a6452f120849 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:08.600525 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d9f09803-f71a-4993-ac29-a6452f120849 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.191962 Sep 06 21:15:08.601285 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 125/257] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:08 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:08.624330 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4dcad6c3-d689-467a-adb0-da6f758a26b2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:08.635012 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4dcad6c3-d689-467a-adb0-da6f758a26b2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:08.636514 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4dcad6c3-d689-467a-adb0-da6f758a26b2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:08.637693 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4dcad6c3-d689-467a-adb0-da6f758a26b2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.190072 Sep 06 21:15:08.638250 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 133/258] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:15:08 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:15:08.914958 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-48f9dbfc-ec12-4d4c-918e-917c907d472a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:08.915774 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-48f9dbfc-ec12-4d4c-918e-917c907d472a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:08.922514 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48f9dbfc-ec12-4d4c-918e-917c907d472a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:08.923206 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48f9dbfc-ec12-4d4c-918e-917c907d472a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:08.923633 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48f9dbfc-ec12-4d4c-918e-917c907d472a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:08.924688 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48f9dbfc-ec12-4d4c-918e-917c907d472a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:08.925166 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48f9dbfc-ec12-4d4c-918e-917c907d472a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:08.925600 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48f9dbfc-ec12-4d4c-918e-917c907d472a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:09.056511 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-02b32972-db68-4419-83a8-dcfae5a2b4ae tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:09.057242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-02b32972-db68-4419-83a8-dcfae5a2b4ae tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:09.062119 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-48f9dbfc-ec12-4d4c-918e-917c907d472a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:09.064865 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02b32972-db68-4419-83a8-dcfae5a2b4ae tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:09.066098 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02b32972-db68-4419-83a8-dcfae5a2b4ae tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:09.066765 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02b32972-db68-4419-83a8-dcfae5a2b4ae tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:09.067670 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02b32972-db68-4419-83a8-dcfae5a2b4ae tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:09.068257 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02b32972-db68-4419-83a8-dcfae5a2b4ae tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:09.068797 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02b32972-db68-4419-83a8-dcfae5a2b4ae tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:09.070771 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-48f9dbfc-ec12-4d4c-918e-917c907d472a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.164398 Sep 06 21:15:09.071429 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 126/259] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:08 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:15:09.206132 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-02b32972-db68-4419-83a8-dcfae5a2b4ae tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:09.214157 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-02b32972-db68-4419-83a8-dcfae5a2b4ae tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.161489 Sep 06 21:15:09.214733 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 134/260] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:09 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:09.624675 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d1855b43-0270-4f3b-a6aa-0a4361b7acf2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:09.625307 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d1855b43-0270-4f3b-a6aa-0a4361b7acf2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:09.631782 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1855b43-0270-4f3b-a6aa-0a4361b7acf2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:09.632379 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1855b43-0270-4f3b-a6aa-0a4361b7acf2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:09.632852 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1855b43-0270-4f3b-a6aa-0a4361b7acf2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:09.633548 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1855b43-0270-4f3b-a6aa-0a4361b7acf2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:09.633990 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1855b43-0270-4f3b-a6aa-0a4361b7acf2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:09.634403 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1855b43-0270-4f3b-a6aa-0a4361b7acf2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:09.663154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3da8d3f2-877a-47c4-ae98-452a91ef5c3c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:09.663721 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3da8d3f2-877a-47c4-ae98-452a91ef5c3c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:09.670028 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3da8d3f2-877a-47c4-ae98-452a91ef5c3c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:09.670506 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3da8d3f2-877a-47c4-ae98-452a91ef5c3c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:09.670924 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3da8d3f2-877a-47c4-ae98-452a91ef5c3c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:09.671782 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3da8d3f2-877a-47c4-ae98-452a91ef5c3c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:09.672223 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3da8d3f2-877a-47c4-ae98-452a91ef5c3c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:09.672741 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3da8d3f2-877a-47c4-ae98-452a91ef5c3c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:09.801225 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d1855b43-0270-4f3b-a6aa-0a4361b7acf2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:09.815075 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d1855b43-0270-4f3b-a6aa-0a4361b7acf2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.194942 Sep 06 21:15:09.829309 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 127/261] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:09 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:09.840296 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3da8d3f2-877a-47c4-ae98-452a91ef5c3c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:09.849771 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3da8d3f2-877a-47c4-ae98-452a91ef5c3c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:09.851094 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3da8d3f2-877a-47c4-ae98-452a91ef5c3c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:09.852201 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3da8d3f2-877a-47c4-ae98-452a91ef5c3c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.193140 Sep 06 21:15:09.852789 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 135/262] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:15:09 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 21:15:10.093859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aacd2985-41bb-44ea-93d5-271e0bee7c3c tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:10.094458 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-aacd2985-41bb-44ea-93d5-271e0bee7c3c tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:10.101410 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aacd2985-41bb-44ea-93d5-271e0bee7c3c tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:10.101930 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aacd2985-41bb-44ea-93d5-271e0bee7c3c tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:10.102358 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aacd2985-41bb-44ea-93d5-271e0bee7c3c tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:10.103070 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aacd2985-41bb-44ea-93d5-271e0bee7c3c tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:10.103563 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aacd2985-41bb-44ea-93d5-271e0bee7c3c tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:10.104190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aacd2985-41bb-44ea-93d5-271e0bee7c3c tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:10.238652 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a4527623-3bab-4d91-8c94-d00c359a27cb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:10.239349 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a4527623-3bab-4d91-8c94-d00c359a27cb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:10.245698 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a4527623-3bab-4d91-8c94-d00c359a27cb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:10.246171 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a4527623-3bab-4d91-8c94-d00c359a27cb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:10.246818 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a4527623-3bab-4d91-8c94-d00c359a27cb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:10.248643 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a4527623-3bab-4d91-8c94-d00c359a27cb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:10.249326 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a4527623-3bab-4d91-8c94-d00c359a27cb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:10.249952 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a4527623-3bab-4d91-8c94-d00c359a27cb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:10.263911 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-aacd2985-41bb-44ea-93d5-271e0bee7c3c tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:10.279793 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-aacd2985-41bb-44ea-93d5-271e0bee7c3c tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.189235 Sep 06 21:15:10.281057 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 128/263] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:10 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:10.417177 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a4527623-3bab-4d91-8c94-d00c359a27cb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:10.430120 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a4527623-3bab-4d91-8c94-d00c359a27cb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.195763 Sep 06 21:15:10.430946 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 136/264] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:10 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:15:10.839806 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e2ae15bc-3d15-47fc-b397-a8446c5353fc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:10.840577 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e2ae15bc-3d15-47fc-b397-a8446c5353fc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:10.846918 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2ae15bc-3d15-47fc-b397-a8446c5353fc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:10.847639 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2ae15bc-3d15-47fc-b397-a8446c5353fc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:10.848055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2ae15bc-3d15-47fc-b397-a8446c5353fc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:10.848981 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2ae15bc-3d15-47fc-b397-a8446c5353fc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:10.849419 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2ae15bc-3d15-47fc-b397-a8446c5353fc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:10.849827 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2ae15bc-3d15-47fc-b397-a8446c5353fc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:10.892430 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8fe0ae9a-a8b7-4953-a681-6e86fe341e37 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:10.892430 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8fe0ae9a-a8b7-4953-a681-6e86fe341e37 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:10.897825 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8fe0ae9a-a8b7-4953-a681-6e86fe341e37 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:10.898682 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8fe0ae9a-a8b7-4953-a681-6e86fe341e37 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:10.899856 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8fe0ae9a-a8b7-4953-a681-6e86fe341e37 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:10.900919 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8fe0ae9a-a8b7-4953-a681-6e86fe341e37 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:10.901574 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8fe0ae9a-a8b7-4953-a681-6e86fe341e37 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:10.902245 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8fe0ae9a-a8b7-4953-a681-6e86fe341e37 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:11.023738 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e2ae15bc-3d15-47fc-b397-a8446c5353fc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:11.036160 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e2ae15bc-3d15-47fc-b397-a8446c5353fc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.200497 Sep 06 21:15:11.037179 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 129/265] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:10 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:15:11.077550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8fe0ae9a-a8b7-4953-a681-6e86fe341e37 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:11.088289 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8fe0ae9a-a8b7-4953-a681-6e86fe341e37 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:11.090225 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8fe0ae9a-a8b7-4953-a681-6e86fe341e37 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:11.092279 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8fe0ae9a-a8b7-4953-a681-6e86fe341e37 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.218358 Sep 06 21:15:11.093030 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 137/266] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:15:10 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:15:11.311459 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ec320637-fa0a-4a48-b35e-387d06990583 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:11.312301 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ec320637-fa0a-4a48-b35e-387d06990583 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:11.319786 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec320637-fa0a-4a48-b35e-387d06990583 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:11.320283 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec320637-fa0a-4a48-b35e-387d06990583 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:11.320696 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec320637-fa0a-4a48-b35e-387d06990583 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:11.321422 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec320637-fa0a-4a48-b35e-387d06990583 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:11.321853 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec320637-fa0a-4a48-b35e-387d06990583 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:11.322284 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec320637-fa0a-4a48-b35e-387d06990583 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:11.457758 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8044ff1d-c058-4c2f-9178-7f59c8241728 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:11.459044 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8044ff1d-c058-4c2f-9178-7f59c8241728 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:11.465852 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8044ff1d-c058-4c2f-9178-7f59c8241728 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:11.465852 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8044ff1d-c058-4c2f-9178-7f59c8241728 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:11.466264 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8044ff1d-c058-4c2f-9178-7f59c8241728 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:11.466954 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8044ff1d-c058-4c2f-9178-7f59c8241728 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:11.467557 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8044ff1d-c058-4c2f-9178-7f59c8241728 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:11.468114 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8044ff1d-c058-4c2f-9178-7f59c8241728 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:11.484868 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ec320637-fa0a-4a48-b35e-387d06990583 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:11.494540 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ec320637-fa0a-4a48-b35e-387d06990583 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.187670 Sep 06 21:15:11.495219 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 130/267] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:11 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:11.614488 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8044ff1d-c058-4c2f-9178-7f59c8241728 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:11.622540 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8044ff1d-c058-4c2f-9178-7f59c8241728 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.171377 Sep 06 21:15:11.622983 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 138/268] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:11 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:12.062539 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3cd5ed93-2701-4bbb-8f50-4447289df469 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:12.064053 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3cd5ed93-2701-4bbb-8f50-4447289df469 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:12.081231 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cd5ed93-2701-4bbb-8f50-4447289df469 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:12.081231 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cd5ed93-2701-4bbb-8f50-4447289df469 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:12.081231 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cd5ed93-2701-4bbb-8f50-4447289df469 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:12.081231 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cd5ed93-2701-4bbb-8f50-4447289df469 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:12.081550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cd5ed93-2701-4bbb-8f50-4447289df469 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:12.081550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cd5ed93-2701-4bbb-8f50-4447289df469 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:12.129164 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-245bd6e9-a1f7-4e38-b691-fb7fb70a8b0a req-d1f23f41-f7f1-432d-afe2-88903fc127d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fea1aa0-032e-454d-9358-98a81cd5d650", "name": "network-vif-plugged", "status": "completed", "tag": "7ea4447f-6e97-421a-ae16-09790d6651e8"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:15:12.144852 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-245bd6e9-a1f7-4e38-b691-fb7fb70a8b0a req-d1f23f41-f7f1-432d-afe2-88903fc127d2 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:12.145723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-245bd6e9-a1f7-4e38-b691-fb7fb70a8b0a req-d1f23f41-f7f1-432d-afe2-88903fc127d2 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:12.146481 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-245bd6e9-a1f7-4e38-b691-fb7fb70a8b0a req-d1f23f41-f7f1-432d-afe2-88903fc127d2 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:12.197133 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-245bd6e9-a1f7-4e38-b691-fb7fb70a8b0a req-d1f23f41-f7f1-432d-afe2-88903fc127d2 service nova] Creating event network-vif-plugged:7ea4447f-6e97-421a-ae16-09790d6651e8 for instance 8fea1aa0-032e-454d-9358-98a81cd5d650 on hv-cinder-74915 Sep 06 21:15:12.215140 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-245bd6e9-a1f7-4e38-b691-fb7fb70a8b0a req-d1f23f41-f7f1-432d-afe2-88903fc127d2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178508 Sep 06 21:15:12.217342 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 131/269] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:15:12.229161 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f396a563-78a2-48ff-81f6-89549af88025 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:12.231222 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f396a563-78a2-48ff-81f6-89549af88025 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:12.244177 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f396a563-78a2-48ff-81f6-89549af88025 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:12.245594 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f396a563-78a2-48ff-81f6-89549af88025 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:12.246510 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f396a563-78a2-48ff-81f6-89549af88025 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:12.248219 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f396a563-78a2-48ff-81f6-89549af88025 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:12.248953 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f396a563-78a2-48ff-81f6-89549af88025 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:12.249783 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f396a563-78a2-48ff-81f6-89549af88025 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:12.280445 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3cd5ed93-2701-4bbb-8f50-4447289df469 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:12.293519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3cd5ed93-2701-4bbb-8f50-4447289df469 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.236604 Sep 06 21:15:12.294401 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 139/270] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:12 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:12.411314 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f396a563-78a2-48ff-81f6-89549af88025 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:12.420018 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f396a563-78a2-48ff-81f6-89549af88025 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:12.421502 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f396a563-78a2-48ff-81f6-89549af88025 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:12.422603 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f396a563-78a2-48ff-81f6-89549af88025 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.203830 Sep 06 21:15:12.423157 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 132/271] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:15:12 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:15:12.519409 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8935a1e4-ed26-4ed4-9afb-a2351e6716cc tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:12.520049 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8935a1e4-ed26-4ed4-9afb-a2351e6716cc tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:12.526268 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8935a1e4-ed26-4ed4-9afb-a2351e6716cc tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:12.526742 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8935a1e4-ed26-4ed4-9afb-a2351e6716cc tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:12.527168 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8935a1e4-ed26-4ed4-9afb-a2351e6716cc tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:12.527931 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8935a1e4-ed26-4ed4-9afb-a2351e6716cc tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:12.528401 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8935a1e4-ed26-4ed4-9afb-a2351e6716cc tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:12.528859 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8935a1e4-ed26-4ed4-9afb-a2351e6716cc tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:12.646226 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-230e4a40-7610-415c-965c-a5881218826c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:12.646833 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-230e4a40-7610-415c-965c-a5881218826c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:12.653795 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-230e4a40-7610-415c-965c-a5881218826c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:12.654490 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-230e4a40-7610-415c-965c-a5881218826c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:12.654919 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-230e4a40-7610-415c-965c-a5881218826c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:12.655621 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-230e4a40-7610-415c-965c-a5881218826c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:12.656066 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-230e4a40-7610-415c-965c-a5881218826c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:12.656488 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-230e4a40-7610-415c-965c-a5881218826c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:12.676818 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8935a1e4-ed26-4ed4-9afb-a2351e6716cc tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:12.684905 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8935a1e4-ed26-4ed4-9afb-a2351e6716cc tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.169455 Sep 06 21:15:12.685570 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 140/272] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:12 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:12.815642 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-230e4a40-7610-415c-965c-a5881218826c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:12.825207 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-230e4a40-7610-415c-965c-a5881218826c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.183351 Sep 06 21:15:12.825797 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 133/273] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:12 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:15:13.324280 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0b03f75a-da79-4a5b-8684-971b23736078 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:13.325216 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0b03f75a-da79-4a5b-8684-971b23736078 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:13.331638 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b03f75a-da79-4a5b-8684-971b23736078 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:13.332212 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b03f75a-da79-4a5b-8684-971b23736078 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:13.332878 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b03f75a-da79-4a5b-8684-971b23736078 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:13.333714 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b03f75a-da79-4a5b-8684-971b23736078 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:13.334227 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b03f75a-da79-4a5b-8684-971b23736078 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:13.334715 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0b03f75a-da79-4a5b-8684-971b23736078 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:13.447834 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9ed12657-41fc-4301-93b8-09df564b06a5 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:13.448415 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9ed12657-41fc-4301-93b8-09df564b06a5 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:13.455490 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ed12657-41fc-4301-93b8-09df564b06a5 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:13.456182 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ed12657-41fc-4301-93b8-09df564b06a5 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:13.456769 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ed12657-41fc-4301-93b8-09df564b06a5 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:13.457826 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ed12657-41fc-4301-93b8-09df564b06a5 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:13.458122 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ed12657-41fc-4301-93b8-09df564b06a5 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:13.458805 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ed12657-41fc-4301-93b8-09df564b06a5 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:13.480526 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0b03f75a-da79-4a5b-8684-971b23736078 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:13.490310 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0b03f75a-da79-4a5b-8684-971b23736078 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.169427 Sep 06 21:15:13.490916 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 141/274] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:13 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:13.601986 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9ed12657-41fc-4301-93b8-09df564b06a5 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:13.614244 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9ed12657-41fc-4301-93b8-09df564b06a5 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:13.615724 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9ed12657-41fc-4301-93b8-09df564b06a5 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:13.617143 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9ed12657-41fc-4301-93b8-09df564b06a5 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.173215 Sep 06 21:15:13.617653 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 134/275] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:15:13 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:15:13.707661 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eeff947a-d73e-47bd-903f-b0583a1b2d98 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:13.708881 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-eeff947a-d73e-47bd-903f-b0583a1b2d98 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:13.715659 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eeff947a-d73e-47bd-903f-b0583a1b2d98 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:13.716139 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eeff947a-d73e-47bd-903f-b0583a1b2d98 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:13.716569 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eeff947a-d73e-47bd-903f-b0583a1b2d98 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:13.717395 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eeff947a-d73e-47bd-903f-b0583a1b2d98 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:13.717837 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eeff947a-d73e-47bd-903f-b0583a1b2d98 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:13.718424 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eeff947a-d73e-47bd-903f-b0583a1b2d98 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:13.852165 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d8fc4312-49e6-4996-a6dc-34d5893abb7d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:13.852965 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d8fc4312-49e6-4996-a6dc-34d5893abb7d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:13.860997 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8fc4312-49e6-4996-a6dc-34d5893abb7d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:13.867519 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8fc4312-49e6-4996-a6dc-34d5893abb7d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:13.868085 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8fc4312-49e6-4996-a6dc-34d5893abb7d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:13.868890 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8fc4312-49e6-4996-a6dc-34d5893abb7d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:13.869343 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-eeff947a-d73e-47bd-903f-b0583a1b2d98 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:13.869777 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8fc4312-49e6-4996-a6dc-34d5893abb7d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:13.870390 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8fc4312-49e6-4996-a6dc-34d5893abb7d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:13.891888 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-eeff947a-d73e-47bd-903f-b0583a1b2d98 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.178014 Sep 06 21:15:13.891888 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 142/276] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:13 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:14.021329 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d8fc4312-49e6-4996-a6dc-34d5893abb7d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:14.031903 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d8fc4312-49e6-4996-a6dc-34d5893abb7d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.183735 Sep 06 21:15:14.032487 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 135/277] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:13 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:15:14.247038 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-8a1a7f01-7758-4753-a415-69ad584dcc1d req-6019024d-5a7b-4771-b6fa-d796a7fe55f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e16f683b-c2c3-4514-a197-cd5d4e109487", "name": "network-vif-plugged", "status": "completed", "tag": "4bfe4568-94b9-4729-ae44-82a7f49cc312"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:15:14.258805 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8a1a7f01-7758-4753-a415-69ad584dcc1d req-6019024d-5a7b-4771-b6fa-d796a7fe55f1 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:14.259273 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8a1a7f01-7758-4753-a415-69ad584dcc1d req-6019024d-5a7b-4771-b6fa-d796a7fe55f1 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:14.259704 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8a1a7f01-7758-4753-a415-69ad584dcc1d req-6019024d-5a7b-4771-b6fa-d796a7fe55f1 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:14.271898 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-8a1a7f01-7758-4753-a415-69ad584dcc1d req-6019024d-5a7b-4771-b6fa-d796a7fe55f1 service nova] Creating event network-vif-plugged:4bfe4568-94b9-4729-ae44-82a7f49cc312 for instance e16f683b-c2c3-4514-a197-cd5d4e109487 on hv-cinder-74915 Sep 06 21:15:14.277796 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-8a1a7f01-7758-4753-a415-69ad584dcc1d req-6019024d-5a7b-4771-b6fa-d796a7fe55f1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036095 Sep 06 21:15:14.278607 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 143/278] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:15:14.514764 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-074988c3-d7ec-423e-84d0-849781315849 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:14.515364 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-074988c3-d7ec-423e-84d0-849781315849 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:14.527272 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-074988c3-d7ec-423e-84d0-849781315849 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:14.528406 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-074988c3-d7ec-423e-84d0-849781315849 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:14.528760 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-074988c3-d7ec-423e-84d0-849781315849 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:14.529747 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-074988c3-d7ec-423e-84d0-849781315849 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:14.530190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-074988c3-d7ec-423e-84d0-849781315849 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:14.530605 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-074988c3-d7ec-423e-84d0-849781315849 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:14.644731 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0c69fd5b-a6b7-48de-9121-0418fe3c050e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:14.645772 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0c69fd5b-a6b7-48de-9121-0418fe3c050e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:14.658744 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c69fd5b-a6b7-48de-9121-0418fe3c050e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:14.661299 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c69fd5b-a6b7-48de-9121-0418fe3c050e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:14.662063 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c69fd5b-a6b7-48de-9121-0418fe3c050e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:14.663141 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c69fd5b-a6b7-48de-9121-0418fe3c050e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:14.664098 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c69fd5b-a6b7-48de-9121-0418fe3c050e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:14.664774 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0c69fd5b-a6b7-48de-9121-0418fe3c050e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:14.726869 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-074988c3-d7ec-423e-84d0-849781315849 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:14.736936 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-074988c3-d7ec-423e-84d0-849781315849 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.225585 Sep 06 21:15:14.738192 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 136/279] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:14 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:14.849552 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0c69fd5b-a6b7-48de-9121-0418fe3c050e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:14.862260 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0c69fd5b-a6b7-48de-9121-0418fe3c050e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:14.864295 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0c69fd5b-a6b7-48de-9121-0418fe3c050e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:14.865698 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0c69fd5b-a6b7-48de-9121-0418fe3c050e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.226163 Sep 06 21:15:14.877542 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 144/280] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:15:14 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:15:14.906453 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f1484b80-7d24-4874-80b4-095f64bbb2e4 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:14.907071 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f1484b80-7d24-4874-80b4-095f64bbb2e4 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:14.915159 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1484b80-7d24-4874-80b4-095f64bbb2e4 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:14.915912 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1484b80-7d24-4874-80b4-095f64bbb2e4 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:14.916485 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1484b80-7d24-4874-80b4-095f64bbb2e4 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:14.917412 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1484b80-7d24-4874-80b4-095f64bbb2e4 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:14.918015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1484b80-7d24-4874-80b4-095f64bbb2e4 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:14.918750 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1484b80-7d24-4874-80b4-095f64bbb2e4 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:15.056200 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b41ffc9f-4907-4067-a975-01f7f18883d9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:15.056852 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b41ffc9f-4907-4067-a975-01f7f18883d9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:15.063598 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b41ffc9f-4907-4067-a975-01f7f18883d9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:15.066682 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b41ffc9f-4907-4067-a975-01f7f18883d9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:15.067147 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b41ffc9f-4907-4067-a975-01f7f18883d9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:15.068039 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b41ffc9f-4907-4067-a975-01f7f18883d9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:15.068633 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b41ffc9f-4907-4067-a975-01f7f18883d9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:15.069414 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b41ffc9f-4907-4067-a975-01f7f18883d9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:15.101212 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f1484b80-7d24-4874-80b4-095f64bbb2e4 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:15.109698 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f1484b80-7d24-4874-80b4-095f64bbb2e4 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.207449 Sep 06 21:15:15.110272 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 137/281] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:14 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:15.267981 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b41ffc9f-4907-4067-a975-01f7f18883d9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:15.285172 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b41ffc9f-4907-4067-a975-01f7f18883d9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.233119 Sep 06 21:15:15.285664 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 145/282] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:15 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:15.763116 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-092d3cf4-2530-4d8e-9e65-afb5484e003e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:15.763689 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-092d3cf4-2530-4d8e-9e65-afb5484e003e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:15.770598 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-092d3cf4-2530-4d8e-9e65-afb5484e003e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:15.770946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-092d3cf4-2530-4d8e-9e65-afb5484e003e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:15.771434 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-092d3cf4-2530-4d8e-9e65-afb5484e003e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:15.772048 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-092d3cf4-2530-4d8e-9e65-afb5484e003e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:15.772492 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-092d3cf4-2530-4d8e-9e65-afb5484e003e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:15.772945 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-092d3cf4-2530-4d8e-9e65-afb5484e003e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:15.895178 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ce59de32-e6c3-464c-93b9-c7862c026cae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:15.897145 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ce59de32-e6c3-464c-93b9-c7862c026cae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:15.905345 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce59de32-e6c3-464c-93b9-c7862c026cae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:15.906277 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce59de32-e6c3-464c-93b9-c7862c026cae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:15.907003 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce59de32-e6c3-464c-93b9-c7862c026cae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:15.909163 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce59de32-e6c3-464c-93b9-c7862c026cae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:15.910855 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce59de32-e6c3-464c-93b9-c7862c026cae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:15.912529 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce59de32-e6c3-464c-93b9-c7862c026cae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:15.971389 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-092d3cf4-2530-4d8e-9e65-afb5484e003e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:15.983922 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-092d3cf4-2530-4d8e-9e65-afb5484e003e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.225096 Sep 06 21:15:15.985273 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 138/283] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:15 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:16.116257 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ce59de32-e6c3-464c-93b9-c7862c026cae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:16.125303 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ce59de32-e6c3-464c-93b9-c7862c026cae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:16.126729 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ce59de32-e6c3-464c-93b9-c7862c026cae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:16.127836 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ce59de32-e6c3-464c-93b9-c7862c026cae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.237827 Sep 06 21:15:16.128494 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 146/284] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:15:15 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 21:15:16.136552 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7446c13a-4b45-4e34-85e7-c67b9d32a0d4 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:16.137375 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7446c13a-4b45-4e34-85e7-c67b9d32a0d4 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:16.143964 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7446c13a-4b45-4e34-85e7-c67b9d32a0d4 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:16.144645 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7446c13a-4b45-4e34-85e7-c67b9d32a0d4 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:16.145237 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7446c13a-4b45-4e34-85e7-c67b9d32a0d4 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:16.145924 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7446c13a-4b45-4e34-85e7-c67b9d32a0d4 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:16.146362 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7446c13a-4b45-4e34-85e7-c67b9d32a0d4 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:16.146768 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7446c13a-4b45-4e34-85e7-c67b9d32a0d4 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:16.293635 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-af17eb21-111a-4677-9995-9693f022bbc7 req-7340bc0d-e844-476d-9ccc-bfae6e9f6b28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689", "name": "network-vif-plugged", "status": "completed", "tag": "0cb98390-2901-4269-98b8-c6584aa71d54"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:15:16.304717 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-af17eb21-111a-4677-9995-9693f022bbc7 req-7340bc0d-e844-476d-9ccc-bfae6e9f6b28 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:16.305208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-af17eb21-111a-4677-9995-9693f022bbc7 req-7340bc0d-e844-476d-9ccc-bfae6e9f6b28 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:16.305609 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-af17eb21-111a-4677-9995-9693f022bbc7 req-7340bc0d-e844-476d-9ccc-bfae6e9f6b28 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:16.318969 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-af17eb21-111a-4677-9995-9693f022bbc7 req-7340bc0d-e844-476d-9ccc-bfae6e9f6b28 service nova] Creating event network-vif-plugged:0cb98390-2901-4269-98b8-c6584aa71d54 for instance ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 on hv-cinder-74915 Sep 06 21:15:16.325739 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-af17eb21-111a-4677-9995-9693f022bbc7 req-7340bc0d-e844-476d-9ccc-bfae6e9f6b28 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036026 Sep 06 21:15:16.326351 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 147/285] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 21:15:16.332038 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-99d50621-692e-4f52-9943-31a027f08e8f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:16.332753 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-99d50621-692e-4f52-9943-31a027f08e8f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:16.340167 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99d50621-692e-4f52-9943-31a027f08e8f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:16.340640 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99d50621-692e-4f52-9943-31a027f08e8f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:16.341101 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99d50621-692e-4f52-9943-31a027f08e8f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:16.342170 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99d50621-692e-4f52-9943-31a027f08e8f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:16.342695 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99d50621-692e-4f52-9943-31a027f08e8f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:16.343151 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-99d50621-692e-4f52-9943-31a027f08e8f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:16.359733 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7446c13a-4b45-4e34-85e7-c67b9d32a0d4 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:16.381203 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7446c13a-4b45-4e34-85e7-c67b9d32a0d4 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.248327 Sep 06 21:15:16.388386 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 139/286] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:16 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:16.527117 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-99d50621-692e-4f52-9943-31a027f08e8f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:16.542677 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-99d50621-692e-4f52-9943-31a027f08e8f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.215104 Sep 06 21:15:16.543476 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 148/287] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:16 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:17.009461 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4f90c891-6706-45c0-bd83-cb1a523b303e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:17.010131 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4f90c891-6706-45c0-bd83-cb1a523b303e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:17.017068 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f90c891-6706-45c0-bd83-cb1a523b303e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:17.017545 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f90c891-6706-45c0-bd83-cb1a523b303e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:17.017980 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f90c891-6706-45c0-bd83-cb1a523b303e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:17.018656 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f90c891-6706-45c0-bd83-cb1a523b303e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:17.019100 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f90c891-6706-45c0-bd83-cb1a523b303e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:17.019551 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f90c891-6706-45c0-bd83-cb1a523b303e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:17.156407 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-221fd2d2-781f-4231-b245-57d68f488a9e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:17.157049 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-221fd2d2-781f-4231-b245-57d68f488a9e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:17.168526 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4f90c891-6706-45c0-bd83-cb1a523b303e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:17.176551 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-221fd2d2-781f-4231-b245-57d68f488a9e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:17.177064 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-221fd2d2-781f-4231-b245-57d68f488a9e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:17.177492 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-221fd2d2-781f-4231-b245-57d68f488a9e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:17.177642 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4f90c891-6706-45c0-bd83-cb1a523b303e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.172247 Sep 06 21:15:17.183938 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-221fd2d2-781f-4231-b245-57d68f488a9e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:17.184121 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 140/288] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:17 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:17.184206 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-221fd2d2-781f-4231-b245-57d68f488a9e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:17.184206 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-221fd2d2-781f-4231-b245-57d68f488a9e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:17.349997 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-221fd2d2-781f-4231-b245-57d68f488a9e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:17.358552 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-221fd2d2-781f-4231-b245-57d68f488a9e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:17.360076 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-221fd2d2-781f-4231-b245-57d68f488a9e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:17.361297 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-221fd2d2-781f-4231-b245-57d68f488a9e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.211463 Sep 06 21:15:17.361959 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 149/289] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:15:17 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:15:17.411303 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c9876f04-435a-42c0-bf04-44f19be1d703 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:17.411808 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c9876f04-435a-42c0-bf04-44f19be1d703 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:17.417809 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9876f04-435a-42c0-bf04-44f19be1d703 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:17.418277 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9876f04-435a-42c0-bf04-44f19be1d703 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:17.418699 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9876f04-435a-42c0-bf04-44f19be1d703 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:17.419511 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9876f04-435a-42c0-bf04-44f19be1d703 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:17.419817 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9876f04-435a-42c0-bf04-44f19be1d703 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:17.420227 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9876f04-435a-42c0-bf04-44f19be1d703 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:17.567531 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-84b52372-a2aa-46fd-a3fb-5fee69c89dda tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:17.568379 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-84b52372-a2aa-46fd-a3fb-5fee69c89dda tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:17.578679 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c9876f04-435a-42c0-bf04-44f19be1d703 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:17.585728 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-84b52372-a2aa-46fd-a3fb-5fee69c89dda tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:17.593614 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c9876f04-435a-42c0-bf04-44f19be1d703 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.186306 Sep 06 21:15:17.594213 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 141/290] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:17 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:17.596832 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-84b52372-a2aa-46fd-a3fb-5fee69c89dda tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:17.597580 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-84b52372-a2aa-46fd-a3fb-5fee69c89dda tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:17.598461 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-84b52372-a2aa-46fd-a3fb-5fee69c89dda tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:17.599043 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-84b52372-a2aa-46fd-a3fb-5fee69c89dda tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:17.599593 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-84b52372-a2aa-46fd-a3fb-5fee69c89dda tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:17.623682 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:17.760501 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-84b52372-a2aa-46fd-a3fb-5fee69c89dda tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:17.772939 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-84b52372-a2aa-46fd-a3fb-5fee69c89dda tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.209837 Sep 06 21:15:17.774034 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 150/291] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:17 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:15:18.201802 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ac79dc35-39a5-4a9e-b4ed-3b54851c5b17 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:18.202454 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ac79dc35-39a5-4a9e-b4ed-3b54851c5b17 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:18.208601 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac79dc35-39a5-4a9e-b4ed-3b54851c5b17 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:18.209103 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac79dc35-39a5-4a9e-b4ed-3b54851c5b17 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:18.209520 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac79dc35-39a5-4a9e-b4ed-3b54851c5b17 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:18.210206 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac79dc35-39a5-4a9e-b4ed-3b54851c5b17 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:18.210642 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac79dc35-39a5-4a9e-b4ed-3b54851c5b17 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:18.211048 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac79dc35-39a5-4a9e-b4ed-3b54851c5b17 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:18.358879 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ac79dc35-39a5-4a9e-b4ed-3b54851c5b17 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:18.363820 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:18.370613 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ac79dc35-39a5-4a9e-b4ed-3b54851c5b17 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.172713 Sep 06 21:15:18.371508 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 142/292] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:18 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:18.392741 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8aa73115-58d7-4d7d-927c-a4d35bcff032 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:18.397303 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8aa73115-58d7-4d7d-927c-a4d35bcff032 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:18.402135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:18.412970 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8aa73115-58d7-4d7d-927c-a4d35bcff032 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:18.413447 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8aa73115-58d7-4d7d-927c-a4d35bcff032 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:18.413862 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8aa73115-58d7-4d7d-927c-a4d35bcff032 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:18.414605 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8aa73115-58d7-4d7d-927c-a4d35bcff032 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:18.414992 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8aa73115-58d7-4d7d-927c-a4d35bcff032 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:18.415445 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8aa73115-58d7-4d7d-927c-a4d35bcff032 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:18.631034 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cec3f035-095a-41ad-8cdc-428d97974f36 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:18.636463 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cec3f035-095a-41ad-8cdc-428d97974f36 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:18.650982 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cec3f035-095a-41ad-8cdc-428d97974f36 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:18.653103 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cec3f035-095a-41ad-8cdc-428d97974f36 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:18.654050 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cec3f035-095a-41ad-8cdc-428d97974f36 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:18.655448 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cec3f035-095a-41ad-8cdc-428d97974f36 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:18.657587 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cec3f035-095a-41ad-8cdc-428d97974f36 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:18.658211 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cec3f035-095a-41ad-8cdc-428d97974f36 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:18.663895 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8aa73115-58d7-4d7d-927c-a4d35bcff032 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:18.676972 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8aa73115-58d7-4d7d-927c-a4d35bcff032 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:18.679412 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8aa73115-58d7-4d7d-927c-a4d35bcff032 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:18.681956 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8aa73115-58d7-4d7d-927c-a4d35bcff032 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.298816 Sep 06 21:15:18.685017 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 151/293] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:15:18 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:15:18.796480 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b11d09ca-40b8-489c-bd2f-fa86d76f5574 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:18.797705 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b11d09ca-40b8-489c-bd2f-fa86d76f5574 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:18.806039 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b11d09ca-40b8-489c-bd2f-fa86d76f5574 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:18.806650 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b11d09ca-40b8-489c-bd2f-fa86d76f5574 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:18.807476 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b11d09ca-40b8-489c-bd2f-fa86d76f5574 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:18.808491 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b11d09ca-40b8-489c-bd2f-fa86d76f5574 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:18.809041 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b11d09ca-40b8-489c-bd2f-fa86d76f5574 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:18.809602 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b11d09ca-40b8-489c-bd2f-fa86d76f5574 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:18.981763 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cec3f035-095a-41ad-8cdc-428d97974f36 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:18.983757 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b11d09ca-40b8-489c-bd2f-fa86d76f5574 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:18.993058 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cec3f035-095a-41ad-8cdc-428d97974f36 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.376999 Sep 06 21:15:18.998197 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b11d09ca-40b8-489c-bd2f-fa86d76f5574 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.206120 Sep 06 21:15:19.005693 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 143/294] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:18 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:15:19.006299 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 152/295] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:18 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:19.395542 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d6cda117-766b-4d03-8a60-c7a076b501e7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:19.396162 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d6cda117-766b-4d03-8a60-c7a076b501e7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:19.399341 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:19.403645 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6cda117-766b-4d03-8a60-c7a076b501e7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:19.404126 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6cda117-766b-4d03-8a60-c7a076b501e7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:19.404550 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6cda117-766b-4d03-8a60-c7a076b501e7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:19.405320 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6cda117-766b-4d03-8a60-c7a076b501e7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:19.405767 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6cda117-766b-4d03-8a60-c7a076b501e7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:19.406180 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6cda117-766b-4d03-8a60-c7a076b501e7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:19.569616 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d6cda117-766b-4d03-8a60-c7a076b501e7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:19.582418 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d6cda117-766b-4d03-8a60-c7a076b501e7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.190336 Sep 06 21:15:19.583745 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 144/296] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:19 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:19.711282 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b9b9d9da-3fb5-41c6-8441-1c547859fe5b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:19.711894 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b9b9d9da-3fb5-41c6-8441-1c547859fe5b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:19.719518 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9b9d9da-3fb5-41c6-8441-1c547859fe5b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:19.720016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9b9d9da-3fb5-41c6-8441-1c547859fe5b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:19.720449 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9b9d9da-3fb5-41c6-8441-1c547859fe5b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:19.721187 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9b9d9da-3fb5-41c6-8441-1c547859fe5b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:19.721830 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9b9d9da-3fb5-41c6-8441-1c547859fe5b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:19.723097 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9b9d9da-3fb5-41c6-8441-1c547859fe5b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:19.913629 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b9b9d9da-3fb5-41c6-8441-1c547859fe5b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:19.929462 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b9b9d9da-3fb5-41c6-8441-1c547859fe5b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:19.932944 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b9b9d9da-3fb5-41c6-8441-1c547859fe5b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:19.934539 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b9b9d9da-3fb5-41c6-8441-1c547859fe5b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.227160 Sep 06 21:15:19.935574 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 153/297] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:15:19 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:15:20.026827 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1b3baa5e-267e-4392-ab6c-d6847af901d6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:20.029062 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d096c692-b162-4111-9537-358b3a3ac1c2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:20.030924 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1b3baa5e-267e-4392-ab6c-d6847af901d6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:20.032176 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d096c692-b162-4111-9537-358b3a3ac1c2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:20.054336 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d096c692-b162-4111-9537-358b3a3ac1c2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:20.054576 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b3baa5e-267e-4392-ab6c-d6847af901d6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:20.055146 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d096c692-b162-4111-9537-358b3a3ac1c2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:20.055739 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b3baa5e-267e-4392-ab6c-d6847af901d6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:20.056253 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d096c692-b162-4111-9537-358b3a3ac1c2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:20.056818 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b3baa5e-267e-4392-ab6c-d6847af901d6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:20.058212 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b3baa5e-267e-4392-ab6c-d6847af901d6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:20.058618 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d096c692-b162-4111-9537-358b3a3ac1c2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:20.059692 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b3baa5e-267e-4392-ab6c-d6847af901d6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:20.060096 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d096c692-b162-4111-9537-358b3a3ac1c2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:20.060831 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b3baa5e-267e-4392-ab6c-d6847af901d6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:20.061294 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d096c692-b162-4111-9537-358b3a3ac1c2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:20.318000 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d096c692-b162-4111-9537-358b3a3ac1c2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:20.342080 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d096c692-b162-4111-9537-358b3a3ac1c2 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.328335 Sep 06 21:15:20.348120 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 145/298] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:20 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:20.358436 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1b3baa5e-267e-4392-ab6c-d6847af901d6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:20.358669 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-afa2e07a-59c3-4e1c-baa7-8ad3ed2b9b67 req-6eb53405-7c6d-4161-a7dc-ad04b9f408e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c787b30-603f-4b67-b10c-519b49f5e43f", "name": "network-vif-plugged", "status": "completed", "tag": "69b5a869-9450-44f8-b04d-e9ee1b517313"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:15:20.368951 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1b3baa5e-267e-4392-ab6c-d6847af901d6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.346944 Sep 06 21:15:20.370130 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-afa2e07a-59c3-4e1c-baa7-8ad3ed2b9b67 req-6eb53405-7c6d-4161-a7dc-ad04b9f408e0 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:20.370869 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-afa2e07a-59c3-4e1c-baa7-8ad3ed2b9b67 req-6eb53405-7c6d-4161-a7dc-ad04b9f408e0 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:20.371588 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-afa2e07a-59c3-4e1c-baa7-8ad3ed2b9b67 req-6eb53405-7c6d-4161-a7dc-ad04b9f408e0 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:20.382194 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 154/299] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:20 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:20.388878 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-afa2e07a-59c3-4e1c-baa7-8ad3ed2b9b67 req-6eb53405-7c6d-4161-a7dc-ad04b9f408e0 service nova] Creating event network-vif-plugged:69b5a869-9450-44f8-b04d-e9ee1b517313 for instance 9c787b30-603f-4b67-b10c-519b49f5e43f on hv-cinder-74915 Sep 06 21:15:20.395163 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-afa2e07a-59c3-4e1c-baa7-8ad3ed2b9b67 req-6eb53405-7c6d-4161-a7dc-ad04b9f408e0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045128 Sep 06 21:15:20.396897 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 146/300] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:15:20.609500 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-31ba9d3f-47e6-4cd8-a8f2-bc65fa669903 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:20.610241 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-31ba9d3f-47e6-4cd8-a8f2-bc65fa669903 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:20.618134 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31ba9d3f-47e6-4cd8-a8f2-bc65fa669903 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:20.619313 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31ba9d3f-47e6-4cd8-a8f2-bc65fa669903 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:20.619842 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31ba9d3f-47e6-4cd8-a8f2-bc65fa669903 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:20.620737 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31ba9d3f-47e6-4cd8-a8f2-bc65fa669903 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:20.621299 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31ba9d3f-47e6-4cd8-a8f2-bc65fa669903 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:20.621810 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31ba9d3f-47e6-4cd8-a8f2-bc65fa669903 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:20.844910 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-31ba9d3f-47e6-4cd8-a8f2-bc65fa669903 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:20.857472 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-31ba9d3f-47e6-4cd8-a8f2-bc65fa669903 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.254532 Sep 06 21:15:20.858062 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 155/301] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:20 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:20.963616 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f1d6bfda-3cf2-4788-a749-66e5fb7aa7b7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:20.964672 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f1d6bfda-3cf2-4788-a749-66e5fb7aa7b7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:20.973167 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1d6bfda-3cf2-4788-a749-66e5fb7aa7b7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:20.973647 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1d6bfda-3cf2-4788-a749-66e5fb7aa7b7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:20.974435 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1d6bfda-3cf2-4788-a749-66e5fb7aa7b7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:20.975446 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1d6bfda-3cf2-4788-a749-66e5fb7aa7b7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:20.975897 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1d6bfda-3cf2-4788-a749-66e5fb7aa7b7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:20.976312 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1d6bfda-3cf2-4788-a749-66e5fb7aa7b7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:21.147907 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f1d6bfda-3cf2-4788-a749-66e5fb7aa7b7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:21.159946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f1d6bfda-3cf2-4788-a749-66e5fb7aa7b7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:21.161668 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f1d6bfda-3cf2-4788-a749-66e5fb7aa7b7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:21.162937 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f1d6bfda-3cf2-4788-a749-66e5fb7aa7b7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.205507 Sep 06 21:15:21.163928 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 147/302] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:15:20 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:15:21.373482 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d20ba5f5-8993-4e85-b388-6fea056898cc tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:21.374143 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d20ba5f5-8993-4e85-b388-6fea056898cc tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:21.381126 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d20ba5f5-8993-4e85-b388-6fea056898cc tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:21.381823 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d20ba5f5-8993-4e85-b388-6fea056898cc tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:21.382435 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d20ba5f5-8993-4e85-b388-6fea056898cc tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:21.383159 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d20ba5f5-8993-4e85-b388-6fea056898cc tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:21.383590 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d20ba5f5-8993-4e85-b388-6fea056898cc tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:21.384004 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d20ba5f5-8993-4e85-b388-6fea056898cc tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:21.401697 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eae89fc8-d47a-4fa2-ac74-a59147640814 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:21.403309 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eae89fc8-d47a-4fa2-ac74-a59147640814 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:21.416378 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eae89fc8-d47a-4fa2-ac74-a59147640814 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:21.417216 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eae89fc8-d47a-4fa2-ac74-a59147640814 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:21.418113 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eae89fc8-d47a-4fa2-ac74-a59147640814 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:21.419791 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eae89fc8-d47a-4fa2-ac74-a59147640814 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:21.420802 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eae89fc8-d47a-4fa2-ac74-a59147640814 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:21.422228 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eae89fc8-d47a-4fa2-ac74-a59147640814 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:21.545644 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d20ba5f5-8993-4e85-b388-6fea056898cc tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:21.559354 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d20ba5f5-8993-4e85-b388-6fea056898cc tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.192270 Sep 06 21:15:21.560381 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 156/303] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:21 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:21.608126 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-eae89fc8-d47a-4fa2-ac74-a59147640814 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:21.618225 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eae89fc8-d47a-4fa2-ac74-a59147640814 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.225475 Sep 06 21:15:21.618803 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 148/304] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:21 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:15:21.882759 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d5fd63ae-d90e-4908-91f6-c6117d77f6c8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:21.884636 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d5fd63ae-d90e-4908-91f6-c6117d77f6c8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:21.893792 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5fd63ae-d90e-4908-91f6-c6117d77f6c8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:21.894813 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5fd63ae-d90e-4908-91f6-c6117d77f6c8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:21.895979 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5fd63ae-d90e-4908-91f6-c6117d77f6c8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:21.897778 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5fd63ae-d90e-4908-91f6-c6117d77f6c8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:21.898681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5fd63ae-d90e-4908-91f6-c6117d77f6c8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:21.899975 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d5fd63ae-d90e-4908-91f6-c6117d77f6c8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:22.056907 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d5fd63ae-d90e-4908-91f6-c6117d77f6c8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:22.067246 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d5fd63ae-d90e-4908-91f6-c6117d77f6c8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.189704 Sep 06 21:15:22.067825 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 157/305] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:21 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:22.193720 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e1110284-f079-4a1c-9bae-3930082a8853 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:22.194621 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e1110284-f079-4a1c-9bae-3930082a8853 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:22.201958 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1110284-f079-4a1c-9bae-3930082a8853 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:22.202441 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1110284-f079-4a1c-9bae-3930082a8853 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:22.202857 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1110284-f079-4a1c-9bae-3930082a8853 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:22.203542 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1110284-f079-4a1c-9bae-3930082a8853 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:22.203994 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1110284-f079-4a1c-9bae-3930082a8853 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:22.204401 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1110284-f079-4a1c-9bae-3930082a8853 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:22.407046 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e1110284-f079-4a1c-9bae-3930082a8853 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:22.419828 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e1110284-f079-4a1c-9bae-3930082a8853 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:22.422845 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e1110284-f079-4a1c-9bae-3930082a8853 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:22.423977 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e1110284-f079-4a1c-9bae-3930082a8853 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.234307 Sep 06 21:15:22.424922 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 149/306] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:15:22 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:15:22.596693 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a5fe572f-bc13-4933-a01b-128ab214fd92 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:22.598129 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a5fe572f-bc13-4933-a01b-128ab214fd92 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:22.605307 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5fe572f-bc13-4933-a01b-128ab214fd92 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:22.606076 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5fe572f-bc13-4933-a01b-128ab214fd92 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:22.606651 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5fe572f-bc13-4933-a01b-128ab214fd92 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:22.609728 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5fe572f-bc13-4933-a01b-128ab214fd92 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:22.610381 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5fe572f-bc13-4933-a01b-128ab214fd92 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:22.610973 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5fe572f-bc13-4933-a01b-128ab214fd92 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:22.654298 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3bc0c25f-a2cd-4f18-936c-8870b9af99f4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:22.655619 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3bc0c25f-a2cd-4f18-936c-8870b9af99f4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:22.670313 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bc0c25f-a2cd-4f18-936c-8870b9af99f4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:22.673011 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bc0c25f-a2cd-4f18-936c-8870b9af99f4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:22.673748 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bc0c25f-a2cd-4f18-936c-8870b9af99f4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:22.676899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bc0c25f-a2cd-4f18-936c-8870b9af99f4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:22.677678 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bc0c25f-a2cd-4f18-936c-8870b9af99f4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:22.678786 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bc0c25f-a2cd-4f18-936c-8870b9af99f4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:22.853868 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a5fe572f-bc13-4933-a01b-128ab214fd92 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:22.865849 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a5fe572f-bc13-4933-a01b-128ab214fd92 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.287021 Sep 06 21:15:22.866427 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 158/307] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:22 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:22.919927 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3bc0c25f-a2cd-4f18-936c-8870b9af99f4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:22.929316 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3bc0c25f-a2cd-4f18-936c-8870b9af99f4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.281106 Sep 06 21:15:22.930471 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 150/308] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:22 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:15:23.024874 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-8a0515ed-24a0-4fcf-8ae2-24456f45139d req-febd47c5-76ec-4b1e-adda-6454f6a8c21c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4f062bd-6aa2-4c00-86a3-7ddc003c1713", "name": "network-vif-plugged", "status": "completed", "tag": "5502eac9-cbbf-4d67-87b5-f4110ae65ddf"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:15:23.038132 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8a0515ed-24a0-4fcf-8ae2-24456f45139d req-febd47c5-76ec-4b1e-adda-6454f6a8c21c service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:23.038964 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8a0515ed-24a0-4fcf-8ae2-24456f45139d req-febd47c5-76ec-4b1e-adda-6454f6a8c21c service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:23.039545 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8a0515ed-24a0-4fcf-8ae2-24456f45139d req-febd47c5-76ec-4b1e-adda-6454f6a8c21c service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:23.062764 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-8a0515ed-24a0-4fcf-8ae2-24456f45139d req-febd47c5-76ec-4b1e-adda-6454f6a8c21c service nova] Creating event network-vif-plugged:5502eac9-cbbf-4d67-87b5-f4110ae65ddf for instance e4f062bd-6aa2-4c00-86a3-7ddc003c1713 on hv-cinder-74915 Sep 06 21:15:23.069258 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-8a0515ed-24a0-4fcf-8ae2-24456f45139d req-febd47c5-76ec-4b1e-adda-6454f6a8c21c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048573 Sep 06 21:15:23.070096 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 159/309] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:15:23.096290 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aa6be70e-9008-48f5-a3f7-3f82dad555c1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:23.097646 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-aa6be70e-9008-48f5-a3f7-3f82dad555c1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:23.109064 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa6be70e-9008-48f5-a3f7-3f82dad555c1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:23.110094 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa6be70e-9008-48f5-a3f7-3f82dad555c1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:23.111033 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa6be70e-9008-48f5-a3f7-3f82dad555c1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:23.113831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa6be70e-9008-48f5-a3f7-3f82dad555c1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:23.114688 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa6be70e-9008-48f5-a3f7-3f82dad555c1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:23.115774 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa6be70e-9008-48f5-a3f7-3f82dad555c1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:23.273040 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-aa6be70e-9008-48f5-a3f7-3f82dad555c1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:23.282939 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-aa6be70e-9008-48f5-a3f7-3f82dad555c1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.194605 Sep 06 21:15:23.283519 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 151/310] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:23 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:23.453185 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f07614c4-3564-4590-ae75-26af3e4be03e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:23.454074 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f07614c4-3564-4590-ae75-26af3e4be03e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:23.462056 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f07614c4-3564-4590-ae75-26af3e4be03e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:23.462758 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f07614c4-3564-4590-ae75-26af3e4be03e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:23.463320 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f07614c4-3564-4590-ae75-26af3e4be03e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:23.464200 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f07614c4-3564-4590-ae75-26af3e4be03e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:23.464872 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f07614c4-3564-4590-ae75-26af3e4be03e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:23.465490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f07614c4-3564-4590-ae75-26af3e4be03e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:23.645070 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f07614c4-3564-4590-ae75-26af3e4be03e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:23.654168 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f07614c4-3564-4590-ae75-26af3e4be03e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:23.655758 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f07614c4-3564-4590-ae75-26af3e4be03e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:23.657080 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f07614c4-3564-4590-ae75-26af3e4be03e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1407 microversion: 2.20 time: 0.208827 Sep 06 21:15:23.657710 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 160/311] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:15:23 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 21:15:23.893801 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5bc8ad42-3aea-44df-a35d-00702af07127 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:23.894518 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5bc8ad42-3aea-44df-a35d-00702af07127 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:23.901563 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bc8ad42-3aea-44df-a35d-00702af07127 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:23.902038 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bc8ad42-3aea-44df-a35d-00702af07127 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:23.902473 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bc8ad42-3aea-44df-a35d-00702af07127 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:23.903161 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bc8ad42-3aea-44df-a35d-00702af07127 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:23.903626 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bc8ad42-3aea-44df-a35d-00702af07127 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:23.904023 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bc8ad42-3aea-44df-a35d-00702af07127 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:23.953797 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-62e34fe9-5faf-48c3-b9ec-509152eb97f1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:23.954605 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-62e34fe9-5faf-48c3-b9ec-509152eb97f1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:23.962410 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62e34fe9-5faf-48c3-b9ec-509152eb97f1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:23.962893 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62e34fe9-5faf-48c3-b9ec-509152eb97f1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:23.963318 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62e34fe9-5faf-48c3-b9ec-509152eb97f1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:23.964015 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62e34fe9-5faf-48c3-b9ec-509152eb97f1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:23.964597 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62e34fe9-5faf-48c3-b9ec-509152eb97f1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:23.965667 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62e34fe9-5faf-48c3-b9ec-509152eb97f1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:24.074859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5bc8ad42-3aea-44df-a35d-00702af07127 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:24.082818 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5bc8ad42-3aea-44df-a35d-00702af07127 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.193714 Sep 06 21:15:24.083746 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 152/312] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:23 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:24.114627 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-62e34fe9-5faf-48c3-b9ec-509152eb97f1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:24.124022 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-62e34fe9-5faf-48c3-b9ec-509152eb97f1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.174026 Sep 06 21:15:24.125026 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 161/313] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:23 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:15:24.306332 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-47805139-5b20-4731-bad5-2077bf75453c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:24.306931 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-47805139-5b20-4731-bad5-2077bf75453c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:24.313450 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47805139-5b20-4731-bad5-2077bf75453c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:24.313925 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47805139-5b20-4731-bad5-2077bf75453c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:24.314363 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47805139-5b20-4731-bad5-2077bf75453c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:24.315095 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47805139-5b20-4731-bad5-2077bf75453c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:24.315582 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47805139-5b20-4731-bad5-2077bf75453c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:24.316003 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47805139-5b20-4731-bad5-2077bf75453c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:24.456567 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-47805139-5b20-4731-bad5-2077bf75453c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:24.465657 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-47805139-5b20-4731-bad5-2077bf75453c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.163123 Sep 06 21:15:24.466323 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 153/314] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:24 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:24.686587 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-25e7ee17-5a71-4aef-b734-3519a44cd6f1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:24.687092 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-25e7ee17-5a71-4aef-b734-3519a44cd6f1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:24.693483 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25e7ee17-5a71-4aef-b734-3519a44cd6f1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:24.693949 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25e7ee17-5a71-4aef-b734-3519a44cd6f1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:24.694382 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25e7ee17-5a71-4aef-b734-3519a44cd6f1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:24.695083 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25e7ee17-5a71-4aef-b734-3519a44cd6f1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:24.695583 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25e7ee17-5a71-4aef-b734-3519a44cd6f1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:24.695951 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25e7ee17-5a71-4aef-b734-3519a44cd6f1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:24.835901 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-25e7ee17-5a71-4aef-b734-3519a44cd6f1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:24.844454 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-25e7ee17-5a71-4aef-b734-3519a44cd6f1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:24.846054 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-25e7ee17-5a71-4aef-b734-3519a44cd6f1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:24.847320 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-25e7ee17-5a71-4aef-b734-3519a44cd6f1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1598 microversion: 2.20 time: 0.165207 Sep 06 21:15:24.847870 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 162/315] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:15:24 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:15:24.876076 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bef9a21d-f206-413b-825c-a1e0cd62d69d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:24.876723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bef9a21d-f206-413b-825c-a1e0cd62d69d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:24.883666 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bef9a21d-f206-413b-825c-a1e0cd62d69d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:24.884140 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bef9a21d-f206-413b-825c-a1e0cd62d69d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:24.884582 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bef9a21d-f206-413b-825c-a1e0cd62d69d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:24.885302 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bef9a21d-f206-413b-825c-a1e0cd62d69d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:24.885742 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bef9a21d-f206-413b-825c-a1e0cd62d69d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:24.886195 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bef9a21d-f206-413b-825c-a1e0cd62d69d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:25.013332 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bef9a21d-f206-413b-825c-a1e0cd62d69d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.144056 Sep 06 21:15:25.013884 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 154/316] 10.222.0.79 () {60 vars in 1316 bytes} [Tue Sep 6 21:15:24 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 21:15:25.109321 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b748c52c-b68d-424f-a1d5-beef56dcf764 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:25.109560 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b748c52c-b68d-424f-a1d5-beef56dcf764 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:25.116635 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b748c52c-b68d-424f-a1d5-beef56dcf764 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:25.117506 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b748c52c-b68d-424f-a1d5-beef56dcf764 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:25.117755 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b748c52c-b68d-424f-a1d5-beef56dcf764 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:25.118353 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b748c52c-b68d-424f-a1d5-beef56dcf764 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:25.118807 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b748c52c-b68d-424f-a1d5-beef56dcf764 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:25.119257 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b748c52c-b68d-424f-a1d5-beef56dcf764 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:25.150628 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e596b896-7aad-4e1c-916f-9e3815b676bb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:25.151347 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e596b896-7aad-4e1c-916f-9e3815b676bb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:25.158983 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e596b896-7aad-4e1c-916f-9e3815b676bb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:25.159642 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e596b896-7aad-4e1c-916f-9e3815b676bb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:25.160268 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e596b896-7aad-4e1c-916f-9e3815b676bb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:25.161111 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e596b896-7aad-4e1c-916f-9e3815b676bb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:25.161655 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e596b896-7aad-4e1c-916f-9e3815b676bb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:25.162143 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e596b896-7aad-4e1c-916f-9e3815b676bb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:25.266903 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b748c52c-b68d-424f-a1d5-beef56dcf764 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:25.275654 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b748c52c-b68d-424f-a1d5-beef56dcf764 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1314 microversion: 2.1 time: 0.171127 Sep 06 21:15:25.276319 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 163/317] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:25 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:25.490351 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-762d18b4-6d32-4730-b60e-36854404a87e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:25.491092 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-762d18b4-6d32-4730-b60e-36854404a87e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:25.510027 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-762d18b4-6d32-4730-b60e-36854404a87e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:25.510560 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-762d18b4-6d32-4730-b60e-36854404a87e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:25.510987 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-762d18b4-6d32-4730-b60e-36854404a87e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:25.511741 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-762d18b4-6d32-4730-b60e-36854404a87e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:25.512206 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-762d18b4-6d32-4730-b60e-36854404a87e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:25.512674 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-762d18b4-6d32-4730-b60e-36854404a87e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:25.523363 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e596b896-7aad-4e1c-916f-9e3815b676bb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:25.534081 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e596b896-7aad-4e1c-916f-9e3815b676bb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.387428 Sep 06 21:15:25.535762 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 155/318] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:25 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:25.699129 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-762d18b4-6d32-4730-b60e-36854404a87e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:25.707144 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-762d18b4-6d32-4730-b60e-36854404a87e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.221402 Sep 06 21:15:25.707706 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 164/319] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:25 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:15:26.298840 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eb06e20c-7fd9-48b2-bd98-54ea06848848 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:26.299800 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eb06e20c-7fd9-48b2-bd98-54ea06848848 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:26.306119 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb06e20c-7fd9-48b2-bd98-54ea06848848 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:26.306570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb06e20c-7fd9-48b2-bd98-54ea06848848 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:26.306982 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb06e20c-7fd9-48b2-bd98-54ea06848848 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:26.307697 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb06e20c-7fd9-48b2-bd98-54ea06848848 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:26.308128 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb06e20c-7fd9-48b2-bd98-54ea06848848 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:26.308532 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb06e20c-7fd9-48b2-bd98-54ea06848848 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:26.528326 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-eb06e20c-7fd9-48b2-bd98-54ea06848848 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:26.536431 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eb06e20c-7fd9-48b2-bd98-54ea06848848 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1501 microversion: 2.1 time: 0.241732 Sep 06 21:15:26.536955 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 156/320] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:26 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1501 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:26.564420 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a3938ed6-22a1-4f2b-8838-ceaff28f96d2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:26.565618 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a3938ed6-22a1-4f2b-8838-ceaff28f96d2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:26.578363 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3938ed6-22a1-4f2b-8838-ceaff28f96d2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:26.578928 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3938ed6-22a1-4f2b-8838-ceaff28f96d2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:26.579428 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3938ed6-22a1-4f2b-8838-ceaff28f96d2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:26.579898 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-92eb3bd4-9faf-46f3-a669-bf60397dfa81 req-17d89041-3592-4368-9757-3fb1bd03854a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fea1aa0-032e-454d-9358-98a81cd5d650", "tag": "7ea4447f-6e97-421a-ae16-09790d6651e8"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:15:26.580265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3938ed6-22a1-4f2b-8838-ceaff28f96d2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:26.580858 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3938ed6-22a1-4f2b-8838-ceaff28f96d2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:26.581694 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3938ed6-22a1-4f2b-8838-ceaff28f96d2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:26.602646 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-92eb3bd4-9faf-46f3-a669-bf60397dfa81 req-17d89041-3592-4368-9757-3fb1bd03854a service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:26.603120 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-92eb3bd4-9faf-46f3-a669-bf60397dfa81 req-17d89041-3592-4368-9757-3fb1bd03854a service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:26.603545 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-92eb3bd4-9faf-46f3-a669-bf60397dfa81 req-17d89041-3592-4368-9757-3fb1bd03854a service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:26.617279 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-92eb3bd4-9faf-46f3-a669-bf60397dfa81 req-17d89041-3592-4368-9757-3fb1bd03854a service nova] Creating event network-changed:7ea4447f-6e97-421a-ae16-09790d6651e8 for instance 8fea1aa0-032e-454d-9358-98a81cd5d650 on hv-cinder-74915 Sep 06 21:15:26.622853 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-92eb3bd4-9faf-46f3-a669-bf60397dfa81 req-17d89041-3592-4368-9757-3fb1bd03854a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047074 Sep 06 21:15:26.624112 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 157/321] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 21:15:26.732899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-78e1f301-e6af-4aff-829a-579fd60cd758 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:26.733592 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-78e1f301-e6af-4aff-829a-579fd60cd758 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:26.745268 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78e1f301-e6af-4aff-829a-579fd60cd758 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:26.748851 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78e1f301-e6af-4aff-829a-579fd60cd758 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:26.750857 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78e1f301-e6af-4aff-829a-579fd60cd758 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:26.754207 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78e1f301-e6af-4aff-829a-579fd60cd758 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:26.754703 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78e1f301-e6af-4aff-829a-579fd60cd758 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:26.756714 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78e1f301-e6af-4aff-829a-579fd60cd758 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:26.786415 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a3938ed6-22a1-4f2b-8838-ceaff28f96d2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:26.796083 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a3938ed6-22a1-4f2b-8838-ceaff28f96d2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.240713 Sep 06 21:15:26.796882 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 165/322] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:26 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:26.962769 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-78e1f301-e6af-4aff-829a-579fd60cd758 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:26.971018 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-78e1f301-e6af-4aff-829a-579fd60cd758 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.244676 Sep 06 21:15:26.972801 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 158/323] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:26 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:15:27.822948 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2c9150a1-0c53-404f-b2db-8278585fe4f9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:27.823667 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2c9150a1-0c53-404f-b2db-8278585fe4f9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:27.830305 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c9150a1-0c53-404f-b2db-8278585fe4f9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:27.830913 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c9150a1-0c53-404f-b2db-8278585fe4f9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:27.831482 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c9150a1-0c53-404f-b2db-8278585fe4f9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:27.832286 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c9150a1-0c53-404f-b2db-8278585fe4f9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:27.833097 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c9150a1-0c53-404f-b2db-8278585fe4f9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:27.833785 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c9150a1-0c53-404f-b2db-8278585fe4f9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:27.973028 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2c9150a1-0c53-404f-b2db-8278585fe4f9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:27.983222 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2c9150a1-0c53-404f-b2db-8278585fe4f9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.165431 Sep 06 21:15:27.984736 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 166/324] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:27 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:28.000520 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-25f39678-8c58-48e4-9fa6-2391d84e9544 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:28.004926 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-25f39678-8c58-48e4-9fa6-2391d84e9544 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:28.011523 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25f39678-8c58-48e4-9fa6-2391d84e9544 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:28.012068 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25f39678-8c58-48e4-9fa6-2391d84e9544 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:28.012699 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25f39678-8c58-48e4-9fa6-2391d84e9544 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:28.013725 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25f39678-8c58-48e4-9fa6-2391d84e9544 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:28.014229 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25f39678-8c58-48e4-9fa6-2391d84e9544 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:28.014686 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25f39678-8c58-48e4-9fa6-2391d84e9544 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:28.162477 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-25f39678-8c58-48e4-9fa6-2391d84e9544 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:28.170756 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-25f39678-8c58-48e4-9fa6-2391d84e9544 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1322 microversion: 2.1 time: 0.175357 Sep 06 21:15:28.171313 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 159/325] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:27 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:29.010008 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d79644bf-af7f-4ec0-88b9-b1d33cc3611e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:29.010609 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d79644bf-af7f-4ec0-88b9-b1d33cc3611e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:29.017047 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d79644bf-af7f-4ec0-88b9-b1d33cc3611e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:29.017525 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d79644bf-af7f-4ec0-88b9-b1d33cc3611e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:29.017947 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d79644bf-af7f-4ec0-88b9-b1d33cc3611e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:29.018634 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d79644bf-af7f-4ec0-88b9-b1d33cc3611e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:29.019151 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d79644bf-af7f-4ec0-88b9-b1d33cc3611e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:29.019563 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d79644bf-af7f-4ec0-88b9-b1d33cc3611e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:29.039262 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:29.160245 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d79644bf-af7f-4ec0-88b9-b1d33cc3611e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:29.168825 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d79644bf-af7f-4ec0-88b9-b1d33cc3611e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.162527 Sep 06 21:15:29.169399 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 167/326] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:29 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:29.194492 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d8b193d9-11ae-491d-97db-923a4804edb5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:29.195180 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d8b193d9-11ae-491d-97db-923a4804edb5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:29.201876 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8b193d9-11ae-491d-97db-923a4804edb5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:29.202356 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8b193d9-11ae-491d-97db-923a4804edb5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:29.202779 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8b193d9-11ae-491d-97db-923a4804edb5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:29.203469 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8b193d9-11ae-491d-97db-923a4804edb5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:29.203907 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8b193d9-11ae-491d-97db-923a4804edb5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:29.204317 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8b193d9-11ae-491d-97db-923a4804edb5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:29.346675 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d8b193d9-11ae-491d-97db-923a4804edb5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:29.356573 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d8b193d9-11ae-491d-97db-923a4804edb5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1515 microversion: 2.1 time: 0.166005 Sep 06 21:15:29.357228 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 160/327] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:29 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:29.381109 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1cfd5faa-7ef4-4313-8eda-3f271978ca66 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:15:29.383538 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1cfd5faa-7ef4-4313-8eda-3f271978ca66 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:29.390087 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1cfd5faa-7ef4-4313-8eda-3f271978ca66 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:29.390621 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1cfd5faa-7ef4-4313-8eda-3f271978ca66 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:29.391014 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1cfd5faa-7ef4-4313-8eda-3f271978ca66 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:29.391838 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1cfd5faa-7ef4-4313-8eda-3f271978ca66 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:29.392345 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1cfd5faa-7ef4-4313-8eda-3f271978ca66 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:29.392762 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1cfd5faa-7ef4-4313-8eda-3f271978ca66 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:29.455779 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-1cfd5faa-7ef4-4313-8eda-3f271978ca66 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lazy-loading 'flavor' on Instance uuid e16f683b-c2c3-4514-a197-cd5d4e109487 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:15:29.575612 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1cfd5faa-7ef4-4313-8eda-3f271978ca66 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "POST /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487/action" status: 200 len: 32 microversion: 2.1 time: 0.199296 Sep 06 21:15:29.576227 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 168/328] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Sep 6 21:15:29 2022] POST /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487/action => generated 32 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 21:15:29.586433 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d802b7fb-4765-4caa-9d6d-2276776c882d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:29.587029 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d802b7fb-4765-4caa-9d6d-2276776c882d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:29.593702 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d802b7fb-4765-4caa-9d6d-2276776c882d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:29.594184 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d802b7fb-4765-4caa-9d6d-2276776c882d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:29.594608 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d802b7fb-4765-4caa-9d6d-2276776c882d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:29.595304 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d802b7fb-4765-4caa-9d6d-2276776c882d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:29.595739 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d802b7fb-4765-4caa-9d6d-2276776c882d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:29.596159 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d802b7fb-4765-4caa-9d6d-2276776c882d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:29.600604 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:29.730230 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d802b7fb-4765-4caa-9d6d-2276776c882d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:29.742338 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d802b7fb-4765-4caa-9d6d-2276776c882d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.159888 Sep 06 21:15:29.743165 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 161/329] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:29 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:30.194085 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4934a7fb-aa11-49b1-8624-5249eee1cfbd tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:30.195509 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4934a7fb-aa11-49b1-8624-5249eee1cfbd tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:30.204803 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4934a7fb-aa11-49b1-8624-5249eee1cfbd tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:30.212393 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4934a7fb-aa11-49b1-8624-5249eee1cfbd tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:30.212881 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4934a7fb-aa11-49b1-8624-5249eee1cfbd tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:30.213634 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4934a7fb-aa11-49b1-8624-5249eee1cfbd tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:30.214082 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4934a7fb-aa11-49b1-8624-5249eee1cfbd tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:30.214499 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4934a7fb-aa11-49b1-8624-5249eee1cfbd tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:30.350654 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4934a7fb-aa11-49b1-8624-5249eee1cfbd tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:30.359847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4934a7fb-aa11-49b1-8624-5249eee1cfbd tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.171338 Sep 06 21:15:30.360230 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 169/330] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:30 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:30.771788 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4412da5f-f05b-46f4-bfc2-83795ccde4a7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:30.772444 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4412da5f-f05b-46f4-bfc2-83795ccde4a7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:30.779158 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4412da5f-f05b-46f4-bfc2-83795ccde4a7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:30.779675 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4412da5f-f05b-46f4-bfc2-83795ccde4a7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:30.780087 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4412da5f-f05b-46f4-bfc2-83795ccde4a7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:30.781040 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4412da5f-f05b-46f4-bfc2-83795ccde4a7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:30.781290 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4412da5f-f05b-46f4-bfc2-83795ccde4a7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:30.781913 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4412da5f-f05b-46f4-bfc2-83795ccde4a7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:31.197224 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4412da5f-f05b-46f4-bfc2-83795ccde4a7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:31.209058 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4412da5f-f05b-46f4-bfc2-83795ccde4a7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.441197 Sep 06 21:15:31.212698 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 162/331] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:30 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:31.269862 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-82ab1dbf-969b-4713-8300-0dc03fdc92bd tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c67e39c7-8e9e-4f7f-a603-dc1318f3f0cb"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:15:31.271509 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-82ab1dbf-969b-4713-8300-0dc03fdc92bd tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:31.282581 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82ab1dbf-969b-4713-8300-0dc03fdc92bd tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:31.283431 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82ab1dbf-969b-4713-8300-0dc03fdc92bd tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:31.284262 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82ab1dbf-969b-4713-8300-0dc03fdc92bd tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:31.285201 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82ab1dbf-969b-4713-8300-0dc03fdc92bd tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:31.285683 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82ab1dbf-969b-4713-8300-0dc03fdc92bd tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:31.286422 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-82ab1dbf-969b-4713-8300-0dc03fdc92bd tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:31.384812 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f24dee78-209f-4606-8522-fab2e9ff556a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:31.385422 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f24dee78-209f-4606-8522-fab2e9ff556a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:31.394304 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f24dee78-209f-4606-8522-fab2e9ff556a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:31.394929 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f24dee78-209f-4606-8522-fab2e9ff556a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:31.395433 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f24dee78-209f-4606-8522-fab2e9ff556a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:31.396170 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f24dee78-209f-4606-8522-fab2e9ff556a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:31.396612 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f24dee78-209f-4606-8522-fab2e9ff556a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:31.397253 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f24dee78-209f-4606-8522-fab2e9ff556a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:31.543308 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f24dee78-209f-4606-8522-fab2e9ff556a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:31.552595 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f24dee78-209f-4606-8522-fab2e9ff556a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.171857 Sep 06 21:15:31.553200 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 163/332] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:31 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:32.238942 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-68ad85a4-cb62-4f23-936f-52a14ec2c2a5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:32.240359 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-68ad85a4-cb62-4f23-936f-52a14ec2c2a5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:32.251728 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68ad85a4-cb62-4f23-936f-52a14ec2c2a5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:32.252336 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68ad85a4-cb62-4f23-936f-52a14ec2c2a5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:32.252910 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68ad85a4-cb62-4f23-936f-52a14ec2c2a5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:32.253708 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68ad85a4-cb62-4f23-936f-52a14ec2c2a5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:32.254384 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68ad85a4-cb62-4f23-936f-52a14ec2c2a5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:32.255113 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68ad85a4-cb62-4f23-936f-52a14ec2c2a5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:32.414227 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-68ad85a4-cb62-4f23-936f-52a14ec2c2a5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:32.422797 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-68ad85a4-cb62-4f23-936f-52a14ec2c2a5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.189793 Sep 06 21:15:32.423223 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 164/333] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:32 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:15:32.581538 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e8009d91-82a2-4e29-bff9-7046e68eb11e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:32.582193 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e8009d91-82a2-4e29-bff9-7046e68eb11e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:32.596015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8009d91-82a2-4e29-bff9-7046e68eb11e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:32.597090 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8009d91-82a2-4e29-bff9-7046e68eb11e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:32.597888 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8009d91-82a2-4e29-bff9-7046e68eb11e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:32.598906 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8009d91-82a2-4e29-bff9-7046e68eb11e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:32.599471 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8009d91-82a2-4e29-bff9-7046e68eb11e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:32.601521 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8009d91-82a2-4e29-bff9-7046e68eb11e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:32.806227 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e8009d91-82a2-4e29-bff9-7046e68eb11e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:32.819590 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e8009d91-82a2-4e29-bff9-7046e68eb11e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.247672 Sep 06 21:15:32.821208 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 165/334] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:32 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:33.446821 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cc075df8-3bb7-4afb-b5e6-cfc5978797fd tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:33.447506 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cc075df8-3bb7-4afb-b5e6-cfc5978797fd tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:33.455440 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc075df8-3bb7-4afb-b5e6-cfc5978797fd tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:33.455920 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc075df8-3bb7-4afb-b5e6-cfc5978797fd tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:33.456393 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc075df8-3bb7-4afb-b5e6-cfc5978797fd tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:33.457196 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc075df8-3bb7-4afb-b5e6-cfc5978797fd tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:33.457630 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc075df8-3bb7-4afb-b5e6-cfc5978797fd tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:33.458098 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc075df8-3bb7-4afb-b5e6-cfc5978797fd tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:33.661294 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cc075df8-3bb7-4afb-b5e6-cfc5978797fd tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:33.678567 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cc075df8-3bb7-4afb-b5e6-cfc5978797fd tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.235838 Sep 06 21:15:33.679862 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 166/335] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:33 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:33.846882 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bd14b129-dffa-41f1-b6ac-6b7f0ea4edeb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:33.847653 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bd14b129-dffa-41f1-b6ac-6b7f0ea4edeb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:33.851865 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-82ab1dbf-969b-4713-8300-0dc03fdc92bd tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "POST /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.588081 Sep 06 21:15:33.852506 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 170/336] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Sep 6 21:15:31 2022] POST /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689/os-volume_attachments => generated 194 bytes in 2590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:15:33.859907 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd14b129-dffa-41f1-b6ac-6b7f0ea4edeb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:33.860607 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd14b129-dffa-41f1-b6ac-6b7f0ea4edeb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:33.861447 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd14b129-dffa-41f1-b6ac-6b7f0ea4edeb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:33.862303 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd14b129-dffa-41f1-b6ac-6b7f0ea4edeb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:33.863095 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd14b129-dffa-41f1-b6ac-6b7f0ea4edeb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:33.863823 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd14b129-dffa-41f1-b6ac-6b7f0ea4edeb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:34.047074 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bd14b129-dffa-41f1-b6ac-6b7f0ea4edeb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:34.055725 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bd14b129-dffa-41f1-b6ac-6b7f0ea4edeb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1362 microversion: 2.1 time: 0.213328 Sep 06 21:15:34.056293 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 167/337] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:33 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:34.705601 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bebea0cd-318a-4789-b39f-1b35df69e86a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:34.706351 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bebea0cd-318a-4789-b39f-1b35df69e86a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:34.717101 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bebea0cd-318a-4789-b39f-1b35df69e86a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:34.717725 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bebea0cd-318a-4789-b39f-1b35df69e86a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:34.718176 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bebea0cd-318a-4789-b39f-1b35df69e86a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:34.719189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bebea0cd-318a-4789-b39f-1b35df69e86a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:34.719841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bebea0cd-318a-4789-b39f-1b35df69e86a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:34.720458 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bebea0cd-318a-4789-b39f-1b35df69e86a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:34.885839 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-bebea0cd-318a-4789-b39f-1b35df69e86a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:34.895424 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bebea0cd-318a-4789-b39f-1b35df69e86a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.195480 Sep 06 21:15:34.895880 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 171/338] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:34 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:35.082792 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2e49a5e6-ae07-4377-8ccf-ab99e10aa523 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:35.084336 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2e49a5e6-ae07-4377-8ccf-ab99e10aa523 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:35.093743 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e49a5e6-ae07-4377-8ccf-ab99e10aa523 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:35.094276 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e49a5e6-ae07-4377-8ccf-ab99e10aa523 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:35.095428 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e49a5e6-ae07-4377-8ccf-ab99e10aa523 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:35.096417 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e49a5e6-ae07-4377-8ccf-ab99e10aa523 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:35.096932 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e49a5e6-ae07-4377-8ccf-ab99e10aa523 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:35.097384 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e49a5e6-ae07-4377-8ccf-ab99e10aa523 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:35.293435 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2e49a5e6-ae07-4377-8ccf-ab99e10aa523 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:35.304680 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2e49a5e6-ae07-4377-8ccf-ab99e10aa523 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1548 microversion: 2.1 time: 0.226248 Sep 06 21:15:35.306295 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 168/339] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:35 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1548 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:15:35.334237 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fc166299-78b8-4d36-8423-6baefc386133 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:35.334733 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fc166299-78b8-4d36-8423-6baefc386133 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:35.352749 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc166299-78b8-4d36-8423-6baefc386133 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:35.356188 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc166299-78b8-4d36-8423-6baefc386133 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:35.357440 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc166299-78b8-4d36-8423-6baefc386133 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:35.358411 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc166299-78b8-4d36-8423-6baefc386133 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:35.359180 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc166299-78b8-4d36-8423-6baefc386133 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:35.359756 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc166299-78b8-4d36-8423-6baefc386133 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:35.475645 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fc166299-78b8-4d36-8423-6baefc386133 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.146138 Sep 06 21:15:35.476229 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 172/340] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Sep 6 21:15:35 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f/os-interface => generated 285 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:15:35.922378 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a041b200-ccf3-4975-b115-7f296e236859 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:35.925061 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a041b200-ccf3-4975-b115-7f296e236859 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:35.931781 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a041b200-ccf3-4975-b115-7f296e236859 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:35.932530 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a041b200-ccf3-4975-b115-7f296e236859 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:35.933101 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a041b200-ccf3-4975-b115-7f296e236859 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:35.934019 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a041b200-ccf3-4975-b115-7f296e236859 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:35.934548 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a041b200-ccf3-4975-b115-7f296e236859 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:35.935181 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a041b200-ccf3-4975-b115-7f296e236859 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:36.194581 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a041b200-ccf3-4975-b115-7f296e236859 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:36.204547 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a041b200-ccf3-4975-b115-7f296e236859 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.287270 Sep 06 21:15:36.207544 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 169/341] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:35 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:36.874031 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-388b3480-0882-42e6-9f77-d8627ac07439 req-33189238-1635-412f-816a-3fa6b0490b5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c787b30-603f-4b67-b10c-519b49f5e43f", "tag": "69b5a869-9450-44f8-b04d-e9ee1b517313"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:15:36.901913 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-388b3480-0882-42e6-9f77-d8627ac07439 req-33189238-1635-412f-816a-3fa6b0490b5c service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:36.906209 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-388b3480-0882-42e6-9f77-d8627ac07439 req-33189238-1635-412f-816a-3fa6b0490b5c service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:36.907248 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-388b3480-0882-42e6-9f77-d8627ac07439 req-33189238-1635-412f-816a-3fa6b0490b5c service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:36.937991 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-388b3480-0882-42e6-9f77-d8627ac07439 req-33189238-1635-412f-816a-3fa6b0490b5c service nova] Creating event network-changed:69b5a869-9450-44f8-b04d-e9ee1b517313 for instance 9c787b30-603f-4b67-b10c-519b49f5e43f on hv-cinder-74915 Sep 06 21:15:36.964108 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-388b3480-0882-42e6-9f77-d8627ac07439 req-33189238-1635-412f-816a-3fa6b0490b5c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094667 Sep 06 21:15:36.969671 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 173/342] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:15:37.237679 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c959a83c-6363-4423-b594-1113c783c5df tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:37.239121 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c959a83c-6363-4423-b594-1113c783c5df tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:37.251314 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c959a83c-6363-4423-b594-1113c783c5df tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:37.252894 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c959a83c-6363-4423-b594-1113c783c5df tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:37.253850 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c959a83c-6363-4423-b594-1113c783c5df tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:37.255054 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c959a83c-6363-4423-b594-1113c783c5df tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:37.255834 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c959a83c-6363-4423-b594-1113c783c5df tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:37.256687 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c959a83c-6363-4423-b594-1113c783c5df tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:37.855417 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c959a83c-6363-4423-b594-1113c783c5df tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:37.875485 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c959a83c-6363-4423-b594-1113c783c5df tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.641885 Sep 06 21:15:37.876759 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 170/343] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:37 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:38.913828 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dc00fe81-984f-4eb1-9d48-6531d5829fe6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:38.915424 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dc00fe81-984f-4eb1-9d48-6531d5829fe6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:38.922759 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc00fe81-984f-4eb1-9d48-6531d5829fe6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:38.923247 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc00fe81-984f-4eb1-9d48-6531d5829fe6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:38.923677 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc00fe81-984f-4eb1-9d48-6531d5829fe6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:38.924765 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc00fe81-984f-4eb1-9d48-6531d5829fe6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:38.925372 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc00fe81-984f-4eb1-9d48-6531d5829fe6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:38.925973 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc00fe81-984f-4eb1-9d48-6531d5829fe6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:39.134845 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-dc00fe81-984f-4eb1-9d48-6531d5829fe6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:39.185933 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dc00fe81-984f-4eb1-9d48-6531d5829fe6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.278352 Sep 06 21:15:39.210888 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 174/344] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:38 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:40.230126 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bd8dcd73-9d16-467e-ad0c-53745ace4a6a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:40.231202 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bd8dcd73-9d16-467e-ad0c-53745ace4a6a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:40.241281 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd8dcd73-9d16-467e-ad0c-53745ace4a6a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:40.241760 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd8dcd73-9d16-467e-ad0c-53745ace4a6a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:40.242152 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd8dcd73-9d16-467e-ad0c-53745ace4a6a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:40.243053 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd8dcd73-9d16-467e-ad0c-53745ace4a6a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:40.243629 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd8dcd73-9d16-467e-ad0c-53745ace4a6a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:40.244242 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd8dcd73-9d16-467e-ad0c-53745ace4a6a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:40.397769 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bd8dcd73-9d16-467e-ad0c-53745ace4a6a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:40.407630 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bd8dcd73-9d16-467e-ad0c-53745ace4a6a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.181382 Sep 06 21:15:40.408373 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 171/345] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:40 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:41.430550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-844e34f2-9fe0-4393-9d31-079d73bbe638 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:41.431227 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-844e34f2-9fe0-4393-9d31-079d73bbe638 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:41.438510 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-844e34f2-9fe0-4393-9d31-079d73bbe638 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:41.438980 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-844e34f2-9fe0-4393-9d31-079d73bbe638 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:41.439408 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-844e34f2-9fe0-4393-9d31-079d73bbe638 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:41.440233 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-844e34f2-9fe0-4393-9d31-079d73bbe638 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:41.440547 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-844e34f2-9fe0-4393-9d31-079d73bbe638 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:41.441009 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-844e34f2-9fe0-4393-9d31-079d73bbe638 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:41.772397 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-844e34f2-9fe0-4393-9d31-079d73bbe638 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:41.780431 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-844e34f2-9fe0-4393-9d31-079d73bbe638 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.353736 Sep 06 21:15:41.781030 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 175/346] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:41 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:42.804316 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6cc0dc05-1396-4f02-927b-b456b102109b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:42.804816 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6cc0dc05-1396-4f02-927b-b456b102109b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:42.811523 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6cc0dc05-1396-4f02-927b-b456b102109b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:42.812000 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6cc0dc05-1396-4f02-927b-b456b102109b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:42.812430 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6cc0dc05-1396-4f02-927b-b456b102109b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:42.813358 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6cc0dc05-1396-4f02-927b-b456b102109b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:42.813810 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6cc0dc05-1396-4f02-927b-b456b102109b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:42.814829 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6cc0dc05-1396-4f02-927b-b456b102109b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:42.956557 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6cc0dc05-1396-4f02-927b-b456b102109b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:42.964203 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6cc0dc05-1396-4f02-927b-b456b102109b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.165157 Sep 06 21:15:42.965023 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 172/347] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:42 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:43.987416 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b397ed8b-05f3-409d-89bf-bf64de495395 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:43.988386 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b397ed8b-05f3-409d-89bf-bf64de495395 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:43.995455 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b397ed8b-05f3-409d-89bf-bf64de495395 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:43.996408 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b397ed8b-05f3-409d-89bf-bf64de495395 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:43.996827 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b397ed8b-05f3-409d-89bf-bf64de495395 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:43.997610 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b397ed8b-05f3-409d-89bf-bf64de495395 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:43.998176 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b397ed8b-05f3-409d-89bf-bf64de495395 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:43.998771 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b397ed8b-05f3-409d-89bf-bf64de495395 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:44.146464 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b397ed8b-05f3-409d-89bf-bf64de495395 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:44.155134 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b397ed8b-05f3-409d-89bf-bf64de495395 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.171782 Sep 06 21:15:44.155701 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 176/348] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:43 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:45.181333 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5427d552-943a-4aec-a562-ba119fffaa7c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:45.181902 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5427d552-943a-4aec-a562-ba119fffaa7c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:45.188170 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5427d552-943a-4aec-a562-ba119fffaa7c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:45.188729 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5427d552-943a-4aec-a562-ba119fffaa7c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:45.189163 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5427d552-943a-4aec-a562-ba119fffaa7c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:45.189853 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5427d552-943a-4aec-a562-ba119fffaa7c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:45.190302 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5427d552-943a-4aec-a562-ba119fffaa7c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:45.190717 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5427d552-943a-4aec-a562-ba119fffaa7c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:45.325067 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5427d552-943a-4aec-a562-ba119fffaa7c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:45.335889 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5427d552-943a-4aec-a562-ba119fffaa7c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.159523 Sep 06 21:15:45.336487 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 173/349] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:45 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:46.359697 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-31c78115-165c-4cc5-8712-21c9758b0941 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:46.360185 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-31c78115-165c-4cc5-8712-21c9758b0941 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:46.366904 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31c78115-165c-4cc5-8712-21c9758b0941 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:46.367376 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31c78115-165c-4cc5-8712-21c9758b0941 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:46.367798 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31c78115-165c-4cc5-8712-21c9758b0941 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:46.368484 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31c78115-165c-4cc5-8712-21c9758b0941 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:46.368961 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31c78115-165c-4cc5-8712-21c9758b0941 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:46.369374 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31c78115-165c-4cc5-8712-21c9758b0941 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:46.503077 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-31c78115-165c-4cc5-8712-21c9758b0941 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:46.511043 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-31c78115-165c-4cc5-8712-21c9758b0941 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.155400 Sep 06 21:15:46.511691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 177/350] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:46 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:47.534916 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-272f9bc1-792b-4fca-8092-b512191b53ae tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:47.535488 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-272f9bc1-792b-4fca-8092-b512191b53ae tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:47.541906 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-272f9bc1-792b-4fca-8092-b512191b53ae tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:47.542433 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-272f9bc1-792b-4fca-8092-b512191b53ae tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:47.542871 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-272f9bc1-792b-4fca-8092-b512191b53ae tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:47.543604 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-272f9bc1-792b-4fca-8092-b512191b53ae tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:47.544050 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-272f9bc1-792b-4fca-8092-b512191b53ae tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:47.544462 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-272f9bc1-792b-4fca-8092-b512191b53ae tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:47.682865 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-272f9bc1-792b-4fca-8092-b512191b53ae tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:47.690815 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-272f9bc1-792b-4fca-8092-b512191b53ae tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.159813 Sep 06 21:15:47.691384 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 174/351] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:47 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:48.716714 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a29714f6-04ab-4b9a-b76e-970c03b150d3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:48.718850 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a29714f6-04ab-4b9a-b76e-970c03b150d3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:48.719888 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=53 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:48.726452 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a29714f6-04ab-4b9a-b76e-970c03b150d3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:48.726929 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a29714f6-04ab-4b9a-b76e-970c03b150d3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:48.727363 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a29714f6-04ab-4b9a-b76e-970c03b150d3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:48.728053 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a29714f6-04ab-4b9a-b76e-970c03b150d3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:48.728506 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a29714f6-04ab-4b9a-b76e-970c03b150d3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:48.728958 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a29714f6-04ab-4b9a-b76e-970c03b150d3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:48.872737 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a29714f6-04ab-4b9a-b76e-970c03b150d3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:48.881690 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a29714f6-04ab-4b9a-b76e-970c03b150d3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.169816 Sep 06 21:15:48.882328 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 178/352] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:48 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:49.907891 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2c7bd50a-e6ca-415a-833b-dfe11e98d776 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:49.908546 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2c7bd50a-e6ca-415a-833b-dfe11e98d776 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:49.910663 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=61 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:49.916885 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c7bd50a-e6ca-415a-833b-dfe11e98d776 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:49.917362 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c7bd50a-e6ca-415a-833b-dfe11e98d776 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:49.917787 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c7bd50a-e6ca-415a-833b-dfe11e98d776 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:49.918470 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c7bd50a-e6ca-415a-833b-dfe11e98d776 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:49.918911 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c7bd50a-e6ca-415a-833b-dfe11e98d776 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:49.919320 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c7bd50a-e6ca-415a-833b-dfe11e98d776 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:50.052112 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2c7bd50a-e6ca-415a-833b-dfe11e98d776 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:50.060425 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2c7bd50a-e6ca-415a-833b-dfe11e98d776 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.156495 Sep 06 21:15:50.061125 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 175/353] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:49 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:51.085926 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-76b6eb8e-7b01-468f-8848-08a8972fb3f3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:51.086520 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-76b6eb8e-7b01-468f-8848-08a8972fb3f3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:51.093043 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76b6eb8e-7b01-468f-8848-08a8972fb3f3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:51.093514 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76b6eb8e-7b01-468f-8848-08a8972fb3f3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:51.093942 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76b6eb8e-7b01-468f-8848-08a8972fb3f3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:51.094633 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76b6eb8e-7b01-468f-8848-08a8972fb3f3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:51.095075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76b6eb8e-7b01-468f-8848-08a8972fb3f3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:51.095494 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76b6eb8e-7b01-468f-8848-08a8972fb3f3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:51.233844 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-76b6eb8e-7b01-468f-8848-08a8972fb3f3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:51.246433 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-76b6eb8e-7b01-468f-8848-08a8972fb3f3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.164962 Sep 06 21:15:51.246907 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 179/354] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:51 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:52.270224 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4b9d7a06-eddb-4f99-a02f-b9a19cc61c4c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:52.270877 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-62ce4a4b-bbd2-46f9-bbf0-f84a1d5f1004 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:52.271230 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4b9d7a06-eddb-4f99-a02f-b9a19cc61c4c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:52.271320 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-62ce4a4b-bbd2-46f9-bbf0-f84a1d5f1004 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:52.277594 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62ce4a4b-bbd2-46f9-bbf0-f84a1d5f1004 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:52.277809 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b9d7a06-eddb-4f99-a02f-b9a19cc61c4c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:52.278071 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62ce4a4b-bbd2-46f9-bbf0-f84a1d5f1004 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:52.278332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b9d7a06-eddb-4f99-a02f-b9a19cc61c4c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:52.278496 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62ce4a4b-bbd2-46f9-bbf0-f84a1d5f1004 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:52.278759 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b9d7a06-eddb-4f99-a02f-b9a19cc61c4c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:52.279234 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62ce4a4b-bbd2-46f9-bbf0-f84a1d5f1004 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:52.279667 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b9d7a06-eddb-4f99-a02f-b9a19cc61c4c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:52.279805 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62ce4a4b-bbd2-46f9-bbf0-f84a1d5f1004 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:52.280080 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62ce4a4b-bbd2-46f9-bbf0-f84a1d5f1004 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:52.280216 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b9d7a06-eddb-4f99-a02f-b9a19cc61c4c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:52.280520 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b9d7a06-eddb-4f99-a02f-b9a19cc61c4c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:52.317931 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-62ce4a4b-bbd2-46f9-bbf0-f84a1d5f1004 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 21:15:52.375551 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:52.455220 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-62ce4a4b-bbd2-46f9-bbf0-f84a1d5f1004 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 204 len: 0 microversion: 2.1 time: 0.188979 Sep 06 21:15:52.456185 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 176/355] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Sep 6 21:15:52 2022] DELETE /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 21:15:52.467054 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1334a601-2435-4fa0-9e7c-65972a3c3b8e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:52.467737 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1334a601-2435-4fa0-9e7c-65972a3c3b8e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:52.471527 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4b9d7a06-eddb-4f99-a02f-b9a19cc61c4c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:52.474123 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1334a601-2435-4fa0-9e7c-65972a3c3b8e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:52.474806 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1334a601-2435-4fa0-9e7c-65972a3c3b8e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:52.475229 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1334a601-2435-4fa0-9e7c-65972a3c3b8e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:52.475931 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1334a601-2435-4fa0-9e7c-65972a3c3b8e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:52.476364 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1334a601-2435-4fa0-9e7c-65972a3c3b8e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:52.476800 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1334a601-2435-4fa0-9e7c-65972a3c3b8e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:52.480758 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4b9d7a06-eddb-4f99-a02f-b9a19cc61c4c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.214290 Sep 06 21:15:52.481336 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 180/356] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:52 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:52.626112 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1334a601-2435-4fa0-9e7c-65972a3c3b8e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:52.634589 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1334a601-2435-4fa0-9e7c-65972a3c3b8e tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1553 microversion: 2.1 time: 0.172986 Sep 06 21:15:52.635268 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 177/357] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:52 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:53.507625 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-015d34b5-3be8-4c8d-94e9-787bd5e92e1f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:53.508235 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-015d34b5-3be8-4c8d-94e9-787bd5e92e1f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:53.515715 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-015d34b5-3be8-4c8d-94e9-787bd5e92e1f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:53.516195 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-015d34b5-3be8-4c8d-94e9-787bd5e92e1f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:53.516624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-015d34b5-3be8-4c8d-94e9-787bd5e92e1f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:53.517352 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-015d34b5-3be8-4c8d-94e9-787bd5e92e1f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:53.517802 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-015d34b5-3be8-4c8d-94e9-787bd5e92e1f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:53.518218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-015d34b5-3be8-4c8d-94e9-787bd5e92e1f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:53.658841 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0f3eb7a9-45b3-44c8-a51b-9962c20f4fa7 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:53.659617 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0f3eb7a9-45b3-44c8-a51b-9962c20f4fa7 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:53.672373 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f3eb7a9-45b3-44c8-a51b-9962c20f4fa7 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:53.672881 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f3eb7a9-45b3-44c8-a51b-9962c20f4fa7 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:53.673301 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f3eb7a9-45b3-44c8-a51b-9962c20f4fa7 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:53.674362 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f3eb7a9-45b3-44c8-a51b-9962c20f4fa7 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:53.674609 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-015d34b5-3be8-4c8d-94e9-787bd5e92e1f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:53.674970 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f3eb7a9-45b3-44c8-a51b-9962c20f4fa7 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:53.675372 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f3eb7a9-45b3-44c8-a51b-9962c20f4fa7 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:53.682633 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:53.691966 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-015d34b5-3be8-4c8d-94e9-787bd5e92e1f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.191010 Sep 06 21:15:53.692520 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 181/358] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:53 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:53.823798 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0f3eb7a9-45b3-44c8-a51b-9962c20f4fa7 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:53.832828 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0f3eb7a9-45b3-44c8-a51b-9962c20f4fa7 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1553 microversion: 2.1 time: 0.178916 Sep 06 21:15:53.833401 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 178/359] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:53 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1553 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:54.716838 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f7fc59b8-638a-4223-9613-d9de3c8b518e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:54.717662 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f7fc59b8-638a-4223-9613-d9de3c8b518e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:54.724515 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7fc59b8-638a-4223-9613-d9de3c8b518e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:54.725060 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7fc59b8-638a-4223-9613-d9de3c8b518e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:54.725679 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7fc59b8-638a-4223-9613-d9de3c8b518e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:54.726429 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7fc59b8-638a-4223-9613-d9de3c8b518e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:54.726870 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7fc59b8-638a-4223-9613-d9de3c8b518e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:54.727299 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7fc59b8-638a-4223-9613-d9de3c8b518e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:54.858929 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c718250e-4934-4372-8b65-de2057cda4be tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:54.859681 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c718250e-4934-4372-8b65-de2057cda4be tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:54.863311 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f7fc59b8-638a-4223-9613-d9de3c8b518e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:54.866798 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c718250e-4934-4372-8b65-de2057cda4be tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:54.867530 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c718250e-4934-4372-8b65-de2057cda4be tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:54.868038 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c718250e-4934-4372-8b65-de2057cda4be tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:54.868842 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c718250e-4934-4372-8b65-de2057cda4be tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:54.869458 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c718250e-4934-4372-8b65-de2057cda4be tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:54.870078 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c718250e-4934-4372-8b65-de2057cda4be tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:54.872751 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f7fc59b8-638a-4223-9613-d9de3c8b518e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.160768 Sep 06 21:15:54.873546 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 182/360] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:54 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:55.069782 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c718250e-4934-4372-8b65-de2057cda4be tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:55.079920 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c718250e-4934-4372-8b65-de2057cda4be tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1553 microversion: 2.1 time: 0.225953 Sep 06 21:15:55.080570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 179/361] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:54 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1553 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:15:55.897847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-18baf42c-5109-4303-8919-bbe83626a40b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:55.898563 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-18baf42c-5109-4303-8919-bbe83626a40b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:55.905580 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-18baf42c-5109-4303-8919-bbe83626a40b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:55.906057 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-18baf42c-5109-4303-8919-bbe83626a40b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:55.906486 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-18baf42c-5109-4303-8919-bbe83626a40b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:55.907185 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-18baf42c-5109-4303-8919-bbe83626a40b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:55.907625 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-18baf42c-5109-4303-8919-bbe83626a40b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:55.908045 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-18baf42c-5109-4303-8919-bbe83626a40b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:56.048270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-18baf42c-5109-4303-8919-bbe83626a40b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:56.056728 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-18baf42c-5109-4303-8919-bbe83626a40b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.163032 Sep 06 21:15:56.057263 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 183/362] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:55 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:56.105215 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-69355bf4-7ca5-41da-a7e9-5142210e4417 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:56.105817 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-69355bf4-7ca5-41da-a7e9-5142210e4417 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:56.111974 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69355bf4-7ca5-41da-a7e9-5142210e4417 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:56.112516 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69355bf4-7ca5-41da-a7e9-5142210e4417 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:56.113055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69355bf4-7ca5-41da-a7e9-5142210e4417 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:56.113853 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69355bf4-7ca5-41da-a7e9-5142210e4417 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:56.114287 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69355bf4-7ca5-41da-a7e9-5142210e4417 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:56.114793 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69355bf4-7ca5-41da-a7e9-5142210e4417 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:56.285686 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-69355bf4-7ca5-41da-a7e9-5142210e4417 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:56.294403 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-69355bf4-7ca5-41da-a7e9-5142210e4417 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1553 microversion: 2.1 time: 0.193087 Sep 06 21:15:56.295048 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 180/363] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:56 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1553 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:57.079870 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fff2d055-f7c9-463b-8ddd-f3b2adfbf5b6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:57.080704 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fff2d055-f7c9-463b-8ddd-f3b2adfbf5b6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:57.091863 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fff2d055-f7c9-463b-8ddd-f3b2adfbf5b6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:57.092357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fff2d055-f7c9-463b-8ddd-f3b2adfbf5b6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:57.093112 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fff2d055-f7c9-463b-8ddd-f3b2adfbf5b6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:57.093839 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fff2d055-f7c9-463b-8ddd-f3b2adfbf5b6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:57.094291 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fff2d055-f7c9-463b-8ddd-f3b2adfbf5b6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:57.094816 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fff2d055-f7c9-463b-8ddd-f3b2adfbf5b6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:57.180693 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-c2ccd81a-a2d0-454c-9098-77b428b31d3a req-e85740e8-9623-43cb-bd8c-5c3dd7a0c204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689", "name": "network-vif-deleted", "tag": "0cb98390-2901-4269-98b8-c6584aa71d54"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:15:57.191176 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c2ccd81a-a2d0-454c-9098-77b428b31d3a req-e85740e8-9623-43cb-bd8c-5c3dd7a0c204 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:57.191651 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c2ccd81a-a2d0-454c-9098-77b428b31d3a req-e85740e8-9623-43cb-bd8c-5c3dd7a0c204 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:57.192077 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c2ccd81a-a2d0-454c-9098-77b428b31d3a req-e85740e8-9623-43cb-bd8c-5c3dd7a0c204 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:57.204758 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-c2ccd81a-a2d0-454c-9098-77b428b31d3a req-e85740e8-9623-43cb-bd8c-5c3dd7a0c204 service nova] Creating event network-vif-deleted:0cb98390-2901-4269-98b8-c6584aa71d54 for instance ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 on hv-cinder-74915 Sep 06 21:15:57.210060 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-c2ccd81a-a2d0-454c-9098-77b428b31d3a req-e85740e8-9623-43cb-bd8c-5c3dd7a0c204 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033118 Sep 06 21:15:57.210664 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 181/364] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:15:57.270931 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-fff2d055-f7c9-463b-8ddd-f3b2adfbf5b6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:57.280442 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fff2d055-f7c9-463b-8ddd-f3b2adfbf5b6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.204748 Sep 06 21:15:57.281032 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 184/365] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:57 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:57.319876 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0578ba22-52d4-4e33-a05c-6e3a0a338941 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:57.320503 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0578ba22-52d4-4e33-a05c-6e3a0a338941 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:57.326930 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0578ba22-52d4-4e33-a05c-6e3a0a338941 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:57.327393 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0578ba22-52d4-4e33-a05c-6e3a0a338941 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:57.327811 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0578ba22-52d4-4e33-a05c-6e3a0a338941 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:57.328481 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0578ba22-52d4-4e33-a05c-6e3a0a338941 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:57.328947 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0578ba22-52d4-4e33-a05c-6e3a0a338941 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:57.329357 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0578ba22-52d4-4e33-a05c-6e3a0a338941 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:57.393586 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0578ba22-52d4-4e33-a05c-6e3a0a338941 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:57.407002 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0578ba22-52d4-4e33-a05c-6e3a0a338941 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1511 microversion: 2.1 time: 0.091194 Sep 06 21:15:57.407820 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 182/366] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:57 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1511 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:58.303873 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-af5db749-ae5f-43cb-aedb-a1efb2b7cfb5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:58.305241 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-af5db749-ae5f-43cb-aedb-a1efb2b7cfb5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:58.312041 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af5db749-ae5f-43cb-aedb-a1efb2b7cfb5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:58.312514 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af5db749-ae5f-43cb-aedb-a1efb2b7cfb5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:58.312976 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af5db749-ae5f-43cb-aedb-a1efb2b7cfb5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:58.313670 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af5db749-ae5f-43cb-aedb-a1efb2b7cfb5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:58.314106 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af5db749-ae5f-43cb-aedb-a1efb2b7cfb5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:58.314523 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af5db749-ae5f-43cb-aedb-a1efb2b7cfb5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:58.433314 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0fde29df-e18f-4908-8991-ed7fd239873a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:58.434900 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0fde29df-e18f-4908-8991-ed7fd239873a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:58.442210 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0fde29df-e18f-4908-8991-ed7fd239873a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:58.442852 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0fde29df-e18f-4908-8991-ed7fd239873a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:58.443997 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0fde29df-e18f-4908-8991-ed7fd239873a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:58.444969 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0fde29df-e18f-4908-8991-ed7fd239873a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:58.445613 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0fde29df-e18f-4908-8991-ed7fd239873a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:58.446218 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0fde29df-e18f-4908-8991-ed7fd239873a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:58.464069 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-af5db749-ae5f-43cb-aedb-a1efb2b7cfb5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:58.479799 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-af5db749-ae5f-43cb-aedb-a1efb2b7cfb5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.179837 Sep 06 21:15:58.481197 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 185/367] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:58 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:58.514084 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0fde29df-e18f-4908-8991-ed7fd239873a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c914e6a41ccc48f49194d57551bdf0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec2d845bf247a6b463e59e513dd936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:58.527748 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0fde29df-e18f-4908-8991-ed7fd239873a tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 200 len: 1345 microversion: 2.1 time: 0.098401 Sep 06 21:15:58.528954 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 183/368] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:58 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 1345 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:15:59.503667 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0a7d48f4-afd3-4d59-b72f-548e6c2a19b7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:59.504271 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0a7d48f4-afd3-4d59-b72f-548e6c2a19b7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:59.511097 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a7d48f4-afd3-4d59-b72f-548e6c2a19b7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:59.511798 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a7d48f4-afd3-4d59-b72f-548e6c2a19b7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:59.512221 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a7d48f4-afd3-4d59-b72f-548e6c2a19b7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:59.513587 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a7d48f4-afd3-4d59-b72f-548e6c2a19b7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:59.514179 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a7d48f4-afd3-4d59-b72f-548e6c2a19b7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:59.514742 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0a7d48f4-afd3-4d59-b72f-548e6c2a19b7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:59.552169 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b6210cd1-18a3-4f10-a2e8-8c3ee7199b58 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:59.553421 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b6210cd1-18a3-4f10-a2e8-8c3ee7199b58 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:59.573503 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6210cd1-18a3-4f10-a2e8-8c3ee7199b58 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:59.574456 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6210cd1-18a3-4f10-a2e8-8c3ee7199b58 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:59.575179 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6210cd1-18a3-4f10-a2e8-8c3ee7199b58 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:59.576244 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6210cd1-18a3-4f10-a2e8-8c3ee7199b58 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:59.576875 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6210cd1-18a3-4f10-a2e8-8c3ee7199b58 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:59.579464 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6210cd1-18a3-4f10-a2e8-8c3ee7199b58 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:59.596927 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-b6210cd1-18a3-4f10-a2e8-8c3ee7199b58 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] HTTP exception thrown: Instance ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 could not be found. Sep 06 21:15:59.601570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b6210cd1-18a3-4f10-a2e8-8c3ee7199b58 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Request method failure captured: Sep 06 21:15:59.601570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 HTTP/1.1 Sep 06 21:15:59.601570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 06 21:15:59.601570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 06 21:15:59.601570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Connection: close Sep 06 21:15:59.601570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 06 21:15:59.601570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 06 21:15:59.601570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Host: 10.222.0.79 Sep 06 21:15:59.601570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 06 21:15:59.601570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 06 21:15:59.601570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjF7gW0B-kW5Ww0hqL-zkudj3Xz0Lt_qFegHIzLDRop_PgmRG3PnMSMfRRJCD6Dh33u9FcrRuvPlF_3L5fZDzmsrGuX3ez-kiTMNIWfNirftIlm3_EEwY4OYhTYkqMjMsZ4Y7ZUJcrmP7OnK0GTORwsO7N6kcaZw-z52gsL9pNJSN29Yg Sep 06 21:15:59.601570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 06 21:15:59.601570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 06 21:15:59.601570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 06 21:15:59.601570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 06 21:15:59.601570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 06 21:15:59.601570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 06 21:15:59.601570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Id: a2ec2d845bf247a6b463e59e513dd936 Sep 06 21:15:59.601570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-DeleteServersTestJSON-1960647090 Sep 06 21:15:59.601570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Role: reader,member Sep 06 21:15:59.601570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Sep 06 21:15:59.602953 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a2ec2d845bf247a6b463e59e513dd936"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a2ec2d845bf247a6b463e59e513dd936", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a2ec2d845bf247a6b463e59e513dd936"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a2ec2d845bf247a6b463e59e513dd936"}]}] Sep 06 21:15:59.602953 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-DeleteServersTestJSON-1960647090 Sep 06 21:15:59.602953 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Id: a2ec2d845bf247a6b463e59e513dd936 Sep 06 21:15:59.602953 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-DeleteServersTestJSON-1960647090 Sep 06 21:15:59.602953 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User: tempest-DeleteServersTestJSON-1960647090-project Sep 06 21:15:59.602953 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 06 21:15:59.602953 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 06 21:15:59.602953 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Id: c914e6a41ccc48f49194d57551bdf0d4 Sep 06 21:15:59.602953 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-DeleteServersTestJSON-1960647090-project Sep 06 21:15:59.602953 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: method: > Sep 06 21:15:59.602953 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: exception: Instance ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 could not be found. Sep 06 21:15:59.602953 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: action_args: {'id': 'ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689'} Sep 06 21:15:59.603691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:15:59.603691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:15:59.603691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:15:59.603691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:15:59.603691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:15:59.603691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:15:59.603691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:15:59.603691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:15:59.603691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:15:59.603691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:15:59.603691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 could not be found. Sep 06 21:15:59.603691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:15:59.603691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:15:59.603691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:15:59.603691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:15:59.603691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:15:59.603691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:15:59.603691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:15:59.603691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:15:59.603691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:15:59.604992 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:15:59.604992 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:15:59.604992 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:15:59.604992 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:15:59.604992 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:15:59.604992 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:15:59.604992 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:15:59.604992 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 could not be found. Sep 06 21:15:59.604992 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:15:59.604992 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:15:59.604992 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:15:59.604992 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:15:59.604992 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:15:59.604992 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:15:59.604992 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:15:59.604992 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:15:59.604992 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 could not be found. Sep 06 21:15:59.604992 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:15:59.606215 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b6210cd1-18a3-4f10-a2e8-8c3ee7199b58 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Returning 404 to user: Instance ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:15:59.606215 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b6210cd1-18a3-4f10-a2e8-8c3ee7199b58 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 404 len: 111 microversion: 2.1 time: 0.055077 Sep 06 21:15:59.606215 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 184/369] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:59 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:15:59.730921 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0a7d48f4-afd3-4d59-b72f-548e6c2a19b7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:15:59.742259 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0a7d48f4-afd3-4d59-b72f-548e6c2a19b7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.242295 Sep 06 21:15:59.743044 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 186/370] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:15:59 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:15:59.765926 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-81c17950-0c39-420f-9ed3-ecd7ce0fcb85 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:15:59.768297 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-81c17950-0c39-420f-9ed3-ecd7ce0fcb85 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:15:59.774352 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81c17950-0c39-420f-9ed3-ecd7ce0fcb85 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:59.774712 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81c17950-0c39-420f-9ed3-ecd7ce0fcb85 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:59.775129 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81c17950-0c39-420f-9ed3-ecd7ce0fcb85 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:59.775815 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81c17950-0c39-420f-9ed3-ecd7ce0fcb85 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:15:59.776899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81c17950-0c39-420f-9ed3-ecd7ce0fcb85 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:15:59.777605 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81c17950-0c39-420f-9ed3-ecd7ce0fcb85 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:15:59.802251 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-81c17950-0c39-420f-9ed3-ecd7ce0fcb85 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] HTTP exception thrown: Instance ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 could not be found. Sep 06 21:15:59.804191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-81c17950-0c39-420f-9ed3-ecd7ce0fcb85 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Request method failure captured: Sep 06 21:15:59.804191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689/os-volume_attachments HTTP/1.1 Sep 06 21:15:59.804191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 06 21:15:59.804191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 06 21:15:59.804191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Connection: close Sep 06 21:15:59.804191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 06 21:15:59.804191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 06 21:15:59.804191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Host: 10.222.0.79 Sep 06 21:15:59.804191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 06 21:15:59.804191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 06 21:15:59.804191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjF7gW0B-kW5Ww0hqL-zkudj3Xz0Lt_qFegHIzLDRop_PgmRG3PnMSMfRRJCD6Dh33u9FcrRuvPlF_3L5fZDzmsrGuX3ez-kiTMNIWfNirftIlm3_EEwY4OYhTYkqMjMsZ4Y7ZUJcrmP7OnK0GTORwsO7N6kcaZw-z52gsL9pNJSN29Yg Sep 06 21:15:59.804191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 06 21:15:59.804191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 06 21:15:59.804191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 06 21:15:59.804191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 06 21:15:59.804191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 06 21:15:59.804191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 06 21:15:59.804191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Id: a2ec2d845bf247a6b463e59e513dd936 Sep 06 21:15:59.804191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-DeleteServersTestJSON-1960647090 Sep 06 21:15:59.804191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Role: reader,member Sep 06 21:15:59.804191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Sep 06 21:15:59.805724 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a2ec2d845bf247a6b463e59e513dd936"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a2ec2d845bf247a6b463e59e513dd936", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a2ec2d845bf247a6b463e59e513dd936"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a2ec2d845bf247a6b463e59e513dd936"}]}] Sep 06 21:15:59.805724 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-DeleteServersTestJSON-1960647090 Sep 06 21:15:59.805724 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Id: a2ec2d845bf247a6b463e59e513dd936 Sep 06 21:15:59.805724 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-DeleteServersTestJSON-1960647090 Sep 06 21:15:59.805724 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User: tempest-DeleteServersTestJSON-1960647090-project Sep 06 21:15:59.805724 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 06 21:15:59.805724 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 06 21:15:59.805724 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Id: c914e6a41ccc48f49194d57551bdf0d4 Sep 06 21:15:59.805724 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-DeleteServersTestJSON-1960647090-project Sep 06 21:15:59.805724 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: method: > Sep 06 21:15:59.805724 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: exception: Instance ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 could not be found. Sep 06 21:15:59.805724 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: action_args: {'server_id': 'ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689'} Sep 06 21:15:59.806657 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:15:59.806657 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:15:59.806657 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:15:59.806657 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:15:59.806657 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:15:59.806657 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:15:59.806657 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:15:59.806657 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:15:59.806657 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:15:59.806657 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:15:59.806657 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 could not be found. Sep 06 21:15:59.806657 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:15:59.806657 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:15:59.806657 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:15:59.806657 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:15:59.806657 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:15:59.806657 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:15:59.806657 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:15:59.806657 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:15:59.806657 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:15:59.807859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:15:59.807859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 21:15:59.807859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 21:15:59.807859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 21:15:59.807859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 21:15:59.807859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 06 21:15:59.807859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 06 21:15:59.807859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:15:59.807859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:15:59.807859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 could not be found. Sep 06 21:15:59.807859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:15:59.807859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:15:59.807859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:15:59.807859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:15:59.807859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:15:59.807859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:15:59.807859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:15:59.807859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:15:59.807859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 could not be found. Sep 06 21:15:59.807859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:15:59.808981 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-81c17950-0c39-420f-9ed3-ecd7ce0fcb85 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Returning 404 to user: Instance ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:15:59.808981 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-81c17950-0c39-420f-9ed3-ecd7ce0fcb85 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044419 Sep 06 21:15:59.808981 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 185/371] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:15:59 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:16:00.768719 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7db6192b-430e-43f7-9ed3-9dbbddb12aa8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:00.769377 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7db6192b-430e-43f7-9ed3-9dbbddb12aa8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:00.784134 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7db6192b-430e-43f7-9ed3-9dbbddb12aa8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:00.784752 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7db6192b-430e-43f7-9ed3-9dbbddb12aa8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:00.785178 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7db6192b-430e-43f7-9ed3-9dbbddb12aa8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:00.785875 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7db6192b-430e-43f7-9ed3-9dbbddb12aa8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:00.786311 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7db6192b-430e-43f7-9ed3-9dbbddb12aa8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:00.786908 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7db6192b-430e-43f7-9ed3-9dbbddb12aa8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:00.936220 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7db6192b-430e-43f7-9ed3-9dbbddb12aa8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:00.946320 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7db6192b-430e-43f7-9ed3-9dbbddb12aa8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.181941 Sep 06 21:16:00.947392 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 187/372] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:00 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:01.970415 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-983b0f5e-7d89-4ae1-b1d3-b1d2cdf351ce tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:01.971726 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-983b0f5e-7d89-4ae1-b1d3-b1d2cdf351ce tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:01.978796 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-983b0f5e-7d89-4ae1-b1d3-b1d2cdf351ce tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:01.979714 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-983b0f5e-7d89-4ae1-b1d3-b1d2cdf351ce tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:01.980164 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-983b0f5e-7d89-4ae1-b1d3-b1d2cdf351ce tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:01.981048 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-983b0f5e-7d89-4ae1-b1d3-b1d2cdf351ce tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:01.981644 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-983b0f5e-7d89-4ae1-b1d3-b1d2cdf351ce tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:01.982215 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-983b0f5e-7d89-4ae1-b1d3-b1d2cdf351ce tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:02.155385 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-983b0f5e-7d89-4ae1-b1d3-b1d2cdf351ce tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:02.163881 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-983b0f5e-7d89-4ae1-b1d3-b1d2cdf351ce tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.197805 Sep 06 21:16:02.164536 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 186/373] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:01 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:03.187544 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e10d051f-7f4c-4c44-b610-f9409f1fa9ac tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:03.188207 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e10d051f-7f4c-4c44-b610-f9409f1fa9ac tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:03.194651 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e10d051f-7f4c-4c44-b610-f9409f1fa9ac tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:03.195128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e10d051f-7f4c-4c44-b610-f9409f1fa9ac tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:03.195549 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e10d051f-7f4c-4c44-b610-f9409f1fa9ac tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:03.196239 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e10d051f-7f4c-4c44-b610-f9409f1fa9ac tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:03.196684 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e10d051f-7f4c-4c44-b610-f9409f1fa9ac tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:03.197127 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e10d051f-7f4c-4c44-b610-f9409f1fa9ac tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:03.341395 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e10d051f-7f4c-4c44-b610-f9409f1fa9ac tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:03.352240 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e10d051f-7f4c-4c44-b610-f9409f1fa9ac tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.168475 Sep 06 21:16:03.352882 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 188/374] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:03 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:04.376127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c60ca6be-66e5-4ac7-aaa2-1c95f2397494 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:04.376846 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c60ca6be-66e5-4ac7-aaa2-1c95f2397494 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:04.383249 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c60ca6be-66e5-4ac7-aaa2-1c95f2397494 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:04.391224 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c60ca6be-66e5-4ac7-aaa2-1c95f2397494 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:04.392021 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c60ca6be-66e5-4ac7-aaa2-1c95f2397494 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:04.393175 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c60ca6be-66e5-4ac7-aaa2-1c95f2397494 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:04.393673 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c60ca6be-66e5-4ac7-aaa2-1c95f2397494 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:04.394102 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c60ca6be-66e5-4ac7-aaa2-1c95f2397494 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:04.524835 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c60ca6be-66e5-4ac7-aaa2-1c95f2397494 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:04.532971 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c60ca6be-66e5-4ac7-aaa2-1c95f2397494 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.160806 Sep 06 21:16:04.533541 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 187/375] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:04 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:05.556366 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-77b9732e-e506-4ad0-ac93-07c7a5c25e66 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:05.557013 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-77b9732e-e506-4ad0-ac93-07c7a5c25e66 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:05.565252 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77b9732e-e506-4ad0-ac93-07c7a5c25e66 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:05.566115 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77b9732e-e506-4ad0-ac93-07c7a5c25e66 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:05.566760 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77b9732e-e506-4ad0-ac93-07c7a5c25e66 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:05.568125 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77b9732e-e506-4ad0-ac93-07c7a5c25e66 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:05.569120 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77b9732e-e506-4ad0-ac93-07c7a5c25e66 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:05.569641 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77b9732e-e506-4ad0-ac93-07c7a5c25e66 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:05.747582 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-77b9732e-e506-4ad0-ac93-07c7a5c25e66 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:05.757522 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-77b9732e-e506-4ad0-ac93-07c7a5c25e66 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.205481 Sep 06 21:16:05.758091 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 189/376] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:05 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:06.350595 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8ff0a613-4573-4004-ab9b-f1ab282ca2e6 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:06.351065 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8ff0a613-4573-4004-ab9b-f1ab282ca2e6 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:06.357495 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ff0a613-4573-4004-ab9b-f1ab282ca2e6 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:06.357970 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ff0a613-4573-4004-ab9b-f1ab282ca2e6 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:06.358390 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ff0a613-4573-4004-ab9b-f1ab282ca2e6 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:06.359077 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ff0a613-4573-4004-ab9b-f1ab282ca2e6 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:06.359514 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ff0a613-4573-4004-ab9b-f1ab282ca2e6 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:06.359941 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ff0a613-4573-4004-ab9b-f1ab282ca2e6 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:06.374810 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-8ff0a613-4573-4004-ab9b-f1ab282ca2e6 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] HTTP exception thrown: Instance ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 could not be found. Sep 06 21:16:06.376343 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8ff0a613-4573-4004-ab9b-f1ab282ca2e6 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Request method failure captured: Sep 06 21:16:06.376343 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 HTTP/1.1 Sep 06 21:16:06.376343 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 06 21:16:06.376343 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 06 21:16:06.376343 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Connection: close Sep 06 21:16:06.376343 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 06 21:16:06.376343 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 06 21:16:06.376343 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Host: 10.222.0.79 Sep 06 21:16:06.376343 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 06 21:16:06.376343 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 06 21:16:06.376343 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjF7gW0B-kW5Ww0hqL-zkudj3Xz0Lt_qFegHIzLDRop_PgmRG3PnMSMfRRJCD6Dh33u9FcrRuvPlF_3L5fZDzmsrGuX3ez-kiTMNIWfNirftIlm3_EEwY4OYhTYkqMjMsZ4Y7ZUJcrmP7OnK0GTORwsO7N6kcaZw-z52gsL9pNJSN29Yg Sep 06 21:16:06.376343 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 06 21:16:06.376343 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 06 21:16:06.376343 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 06 21:16:06.376343 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 06 21:16:06.376343 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 06 21:16:06.376343 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 06 21:16:06.376343 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Id: a2ec2d845bf247a6b463e59e513dd936 Sep 06 21:16:06.376343 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-DeleteServersTestJSON-1960647090 Sep 06 21:16:06.376343 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Role: reader,member Sep 06 21:16:06.376343 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Sep 06 21:16:06.377821 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a2ec2d845bf247a6b463e59e513dd936"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a2ec2d845bf247a6b463e59e513dd936", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a2ec2d845bf247a6b463e59e513dd936"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a2ec2d845bf247a6b463e59e513dd936"}]}] Sep 06 21:16:06.377821 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-DeleteServersTestJSON-1960647090 Sep 06 21:16:06.377821 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Id: a2ec2d845bf247a6b463e59e513dd936 Sep 06 21:16:06.377821 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-DeleteServersTestJSON-1960647090 Sep 06 21:16:06.377821 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User: tempest-DeleteServersTestJSON-1960647090-project Sep 06 21:16:06.377821 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 06 21:16:06.377821 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 06 21:16:06.377821 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Id: c914e6a41ccc48f49194d57551bdf0d4 Sep 06 21:16:06.377821 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-DeleteServersTestJSON-1960647090-project Sep 06 21:16:06.377821 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: method: > Sep 06 21:16:06.377821 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: exception: Instance ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 could not be found. Sep 06 21:16:06.377821 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: action_args: {'id': 'ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689'} Sep 06 21:16:06.378600 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:16:06.378600 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:16:06.378600 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:16:06.378600 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:16:06.378600 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:16:06.378600 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:16:06.378600 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:16:06.378600 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:16:06.378600 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:16:06.378600 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:16:06.378600 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 could not be found. Sep 06 21:16:06.378600 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:16:06.378600 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:16:06.378600 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:16:06.378600 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:16:06.378600 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:16:06.378600 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:16:06.378600 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:16:06.378600 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:16:06.378600 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:16:06.379884 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:16:06.379884 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 21:16:06.379884 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 21:16:06.379884 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 21:16:06.379884 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 21:16:06.379884 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:16:06.379884 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:16:06.379884 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:16:06.379884 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:16:06.379884 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 could not be found. Sep 06 21:16:06.379884 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:16:06.379884 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:16:06.379884 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:16:06.379884 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:16:06.379884 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:16:06.379884 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:16:06.379884 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:16:06.379884 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:16:06.379884 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 could not be found. Sep 06 21:16:06.379884 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:16:06.381394 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8ff0a613-4573-4004-ab9b-f1ab282ca2e6 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Returning 404 to user: Instance ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:16:06.381394 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8ff0a613-4573-4004-ab9b-f1ab282ca2e6 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 404 len: 111 microversion: 2.1 time: 0.031140 Sep 06 21:16:06.381394 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 188/377] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Sep 6 21:16:06 2022] DELETE /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:16:06.390332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8d761a8a-0f8f-46a9-bb97-40644edb7381 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:06.390332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8d761a8a-0f8f-46a9-bb97-40644edb7381 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] [instance: ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:06.395370 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d761a8a-0f8f-46a9-bb97-40644edb7381 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:06.395782 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d761a8a-0f8f-46a9-bb97-40644edb7381 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:06.396203 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d761a8a-0f8f-46a9-bb97-40644edb7381 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:06.396918 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d761a8a-0f8f-46a9-bb97-40644edb7381 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:06.397360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d761a8a-0f8f-46a9-bb97-40644edb7381 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:06.397756 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8d761a8a-0f8f-46a9-bb97-40644edb7381 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:06.415615 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-8d761a8a-0f8f-46a9-bb97-40644edb7381 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] HTTP exception thrown: Instance ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 could not be found. Sep 06 21:16:06.420381 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8d761a8a-0f8f-46a9-bb97-40644edb7381 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Request method failure captured: Sep 06 21:16:06.420381 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 HTTP/1.1 Sep 06 21:16:06.420381 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:16:06.420381 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:16:06.420381 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:16:06.420381 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:16:06.420381 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:16:06.420381 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:16:06.420381 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:16:06.420381 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:16:06.420381 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7gW0B-kW5Ww0hqL-zkudj3Xz0Lt_qFegHIzLDRop_PgmRG3PnMSMfRRJCD6Dh33u9FcrRuvPlF_3L5fZDzmsrGuX3ez-kiTMNIWfNirftIlm3_EEwY4OYhTYkqMjMsZ4Y7ZUJcrmP7OnK0GTORwsO7N6kcaZw-z52gsL9pNJSN29Yg Sep 06 21:16:06.420381 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:16:06.420381 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:16:06.420381 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:16:06.420381 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:16:06.420381 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:16:06.420381 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:16:06.420381 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: a2ec2d845bf247a6b463e59e513dd936 Sep 06 21:16:06.420381 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-DeleteServersTestJSON-1960647090 Sep 06 21:16:06.420381 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:16:06.420381 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:16:06.421949 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a2ec2d845bf247a6b463e59e513dd936"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a2ec2d845bf247a6b463e59e513dd936", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a2ec2d845bf247a6b463e59e513dd936"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a2ec2d845bf247a6b463e59e513dd936"}]}] Sep 06 21:16:06.421949 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-DeleteServersTestJSON-1960647090 Sep 06 21:16:06.421949 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: a2ec2d845bf247a6b463e59e513dd936 Sep 06 21:16:06.421949 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-DeleteServersTestJSON-1960647090 Sep 06 21:16:06.421949 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-DeleteServersTestJSON-1960647090-project Sep 06 21:16:06.421949 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:16:06.421949 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:16:06.421949 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: c914e6a41ccc48f49194d57551bdf0d4 Sep 06 21:16:06.421949 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-DeleteServersTestJSON-1960647090-project Sep 06 21:16:06.421949 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: > Sep 06 21:16:06.421949 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Instance ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 could not be found. Sep 06 21:16:06.421949 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'id': 'ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689'} Sep 06 21:16:06.426712 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:16:06.426712 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:16:06.426712 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:16:06.426712 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:16:06.426712 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:16:06.426712 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:16:06.426712 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:16:06.426712 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:16:06.426712 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:16:06.426712 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:16:06.426712 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 could not be found. Sep 06 21:16:06.426712 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:16:06.426712 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:16:06.426712 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:16:06.426712 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:16:06.426712 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:16:06.426712 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:16:06.426712 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:16:06.426712 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:16:06.426712 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:16:06.428672 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:16:06.428672 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:16:06.428672 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:16:06.428672 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:16:06.428672 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:16:06.428672 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:16:06.428672 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:16:06.428672 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 could not be found. Sep 06 21:16:06.428672 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:16:06.428672 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:16:06.428672 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:16:06.428672 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:16:06.428672 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:16:06.428672 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:16:06.428672 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:16:06.428672 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:16:06.428672 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 could not be found. Sep 06 21:16:06.428672 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:16:06.431722 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8d761a8a-0f8f-46a9-bb97-40644edb7381 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] Returning 404 to user: Instance ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:16:06.431722 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8d761a8a-0f8f-46a9-bb97-40644edb7381 tempest-DeleteServersTestJSON-1960647090 tempest-DeleteServersTestJSON-1960647090-project] 10.222.0.79 "GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689" status: 404 len: 111 microversion: 2.1 time: 0.038470 Sep 06 21:16:06.431722 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 190/378] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:06 2022] GET /compute/v2.1/servers/ea7b0e8d-7840-4ed2-b9c4-03c08e4c7689 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:16:06.781889 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0da50867-1df6-4732-a6ba-f92163a664ad tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:06.782500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0da50867-1df6-4732-a6ba-f92163a664ad tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:06.789094 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0da50867-1df6-4732-a6ba-f92163a664ad tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:06.789725 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0da50867-1df6-4732-a6ba-f92163a664ad tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:06.790161 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0da50867-1df6-4732-a6ba-f92163a664ad tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:06.791054 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0da50867-1df6-4732-a6ba-f92163a664ad tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:06.791508 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0da50867-1df6-4732-a6ba-f92163a664ad tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:06.791931 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0da50867-1df6-4732-a6ba-f92163a664ad tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:07.304941 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0da50867-1df6-4732-a6ba-f92163a664ad tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:07.317001 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0da50867-1df6-4732-a6ba-f92163a664ad tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.539218 Sep 06 21:16:07.320831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 189/379] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:06 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:08.340463 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8c274311-09d0-4d37-abae-65e03d6efb34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:08.341233 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8c274311-09d0-4d37-abae-65e03d6efb34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:08.348206 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c274311-09d0-4d37-abae-65e03d6efb34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:08.348917 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c274311-09d0-4d37-abae-65e03d6efb34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:08.349649 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c274311-09d0-4d37-abae-65e03d6efb34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:08.350386 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c274311-09d0-4d37-abae-65e03d6efb34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:08.350806 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c274311-09d0-4d37-abae-65e03d6efb34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:08.351243 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c274311-09d0-4d37-abae-65e03d6efb34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:08.505665 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8c274311-09d0-4d37-abae-65e03d6efb34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:08.516939 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8c274311-09d0-4d37-abae-65e03d6efb34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.180613 Sep 06 21:16:08.518163 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 191/380] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:08 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:09.542951 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9cf53a81-9186-4469-96dd-8999d71f48b1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:09.543567 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9cf53a81-9186-4469-96dd-8999d71f48b1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:09.550727 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9cf53a81-9186-4469-96dd-8999d71f48b1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:09.551190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9cf53a81-9186-4469-96dd-8999d71f48b1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:09.551604 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9cf53a81-9186-4469-96dd-8999d71f48b1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:09.552455 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9cf53a81-9186-4469-96dd-8999d71f48b1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:09.553521 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9cf53a81-9186-4469-96dd-8999d71f48b1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:09.554124 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9cf53a81-9186-4469-96dd-8999d71f48b1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:09.785011 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9cf53a81-9186-4469-96dd-8999d71f48b1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:09.795480 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9cf53a81-9186-4469-96dd-8999d71f48b1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.256937 Sep 06 21:16:09.796553 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 190/381] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:09 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:10.819828 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ef956938-1eeb-4bf3-9318-7af5c9f37a59 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:10.820425 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ef956938-1eeb-4bf3-9318-7af5c9f37a59 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:10.827866 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef956938-1eeb-4bf3-9318-7af5c9f37a59 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:10.828645 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef956938-1eeb-4bf3-9318-7af5c9f37a59 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:10.829402 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef956938-1eeb-4bf3-9318-7af5c9f37a59 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:10.830298 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef956938-1eeb-4bf3-9318-7af5c9f37a59 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:10.830980 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef956938-1eeb-4bf3-9318-7af5c9f37a59 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:10.831566 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef956938-1eeb-4bf3-9318-7af5c9f37a59 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:11.041907 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ef956938-1eeb-4bf3-9318-7af5c9f37a59 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:11.051562 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ef956938-1eeb-4bf3-9318-7af5c9f37a59 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.235567 Sep 06 21:16:11.052163 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 192/382] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:10 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:12.075031 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6f3404d0-6d56-4f04-b328-755f6fcaf86b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:12.077026 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6f3404d0-6d56-4f04-b328-755f6fcaf86b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:12.084327 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f3404d0-6d56-4f04-b328-755f6fcaf86b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:12.085317 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f3404d0-6d56-4f04-b328-755f6fcaf86b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:12.086842 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f3404d0-6d56-4f04-b328-755f6fcaf86b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:12.088322 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f3404d0-6d56-4f04-b328-755f6fcaf86b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:12.089257 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f3404d0-6d56-4f04-b328-755f6fcaf86b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:12.089969 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f3404d0-6d56-4f04-b328-755f6fcaf86b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:12.271321 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6f3404d0-6d56-4f04-b328-755f6fcaf86b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:12.281398 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6f3404d0-6d56-4f04-b328-755f6fcaf86b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.210026 Sep 06 21:16:12.299433 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 191/383] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:12 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:13.313664 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e04a479a-59eb-4a47-a8d6-4657a174dc4f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:13.314504 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e04a479a-59eb-4a47-a8d6-4657a174dc4f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:13.322945 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e04a479a-59eb-4a47-a8d6-4657a174dc4f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:13.323699 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e04a479a-59eb-4a47-a8d6-4657a174dc4f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:13.324644 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e04a479a-59eb-4a47-a8d6-4657a174dc4f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:13.325456 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e04a479a-59eb-4a47-a8d6-4657a174dc4f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:13.326218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e04a479a-59eb-4a47-a8d6-4657a174dc4f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:13.326870 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e04a479a-59eb-4a47-a8d6-4657a174dc4f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:13.467345 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e04a479a-59eb-4a47-a8d6-4657a174dc4f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:13.475460 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e04a479a-59eb-4a47-a8d6-4657a174dc4f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.166954 Sep 06 21:16:13.476023 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 193/384] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:13 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:14.499787 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1983c6a3-b9f4-41cc-8a45-5225cdd6de34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:14.500395 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1983c6a3-b9f4-41cc-8a45-5225cdd6de34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:14.506837 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1983c6a3-b9f4-41cc-8a45-5225cdd6de34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:14.507319 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1983c6a3-b9f4-41cc-8a45-5225cdd6de34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:14.507745 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1983c6a3-b9f4-41cc-8a45-5225cdd6de34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:14.508507 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1983c6a3-b9f4-41cc-8a45-5225cdd6de34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:14.509053 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1983c6a3-b9f4-41cc-8a45-5225cdd6de34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:14.509498 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1983c6a3-b9f4-41cc-8a45-5225cdd6de34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:14.679341 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1983c6a3-b9f4-41cc-8a45-5225cdd6de34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:14.691420 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1983c6a3-b9f4-41cc-8a45-5225cdd6de34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.195599 Sep 06 21:16:14.700745 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 192/385] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:14 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:14.998843 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-73d767f7-44d1-4a55-9511-0608ce545a4a tempest-VolumesTestJSON-2133315537 tempest-VolumesTestJSON-2133315537-project] Calling method '.version_select at 0x7f04ce6caf70>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:15.054601 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-73d767f7-44d1-4a55-9511-0608ce545a4a tempest-VolumesTestJSON-2133315537 tempest-VolumesTestJSON-2133315537-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/dc2dd61c-fe15-4586-b269-a8bd9e9d63f7" status: 200 len: 350 microversion: 2.1 time: 0.059619 Sep 06 21:16:15.056293 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 194/386] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Sep 6 21:16:14 2022] GET /compute/v2.1/os-volumes/dc2dd61c-fe15-4586-b269-a8bd9e9d63f7 => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:16:15.715366 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d57c1a23-fe45-4df7-bbcd-9af03238db5d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:15.716416 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d57c1a23-fe45-4df7-bbcd-9af03238db5d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:15.723993 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d57c1a23-fe45-4df7-bbcd-9af03238db5d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:15.724548 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d57c1a23-fe45-4df7-bbcd-9af03238db5d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:15.725098 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d57c1a23-fe45-4df7-bbcd-9af03238db5d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:15.725805 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d57c1a23-fe45-4df7-bbcd-9af03238db5d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:15.726286 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d57c1a23-fe45-4df7-bbcd-9af03238db5d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:15.726819 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d57c1a23-fe45-4df7-bbcd-9af03238db5d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:15.963529 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d57c1a23-fe45-4df7-bbcd-9af03238db5d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:15.973133 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d57c1a23-fe45-4df7-bbcd-9af03238db5d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.261488 Sep 06 21:16:15.973875 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 193/387] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:15 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:17.002981 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-863baf19-8973-4c1c-9976-1ff5ac8eb450 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:17.003875 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-863baf19-8973-4c1c-9976-1ff5ac8eb450 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:17.011177 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-863baf19-8973-4c1c-9976-1ff5ac8eb450 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:17.011762 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-863baf19-8973-4c1c-9976-1ff5ac8eb450 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:17.012280 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-863baf19-8973-4c1c-9976-1ff5ac8eb450 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:17.013439 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-863baf19-8973-4c1c-9976-1ff5ac8eb450 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:17.014019 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-863baf19-8973-4c1c-9976-1ff5ac8eb450 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:17.014428 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-863baf19-8973-4c1c-9976-1ff5ac8eb450 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:17.160982 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-863baf19-8973-4c1c-9976-1ff5ac8eb450 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:17.168883 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-863baf19-8973-4c1c-9976-1ff5ac8eb450 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.170983 Sep 06 21:16:17.169474 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 195/388] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:16 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:17.547447 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2367e2e7-83b8-4d60-be3e-cd506bc12af6 tempest-VolumesTestJSON-2133315537 tempest-VolumesTestJSON-2133315537-project] Calling method '.version_select at 0x7f04ce759e50>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:17.597996 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2367e2e7-83b8-4d60-be3e-cd506bc12af6 tempest-VolumesTestJSON-2133315537 tempest-VolumesTestJSON-2133315537-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/65d7e4f8-da69-4f27-a27f-794f56920b97" status: 200 len: 350 microversion: 2.1 time: 0.054619 Sep 06 21:16:17.598666 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 194/389] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Sep 6 21:16:17 2022] GET /compute/v2.1/os-volumes/65d7e4f8-da69-4f27-a27f-794f56920b97 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:16:18.201441 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-49b42849-ad22-4d1f-b7b8-98181dfc1653 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:18.202019 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-49b42849-ad22-4d1f-b7b8-98181dfc1653 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:18.210142 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-49b42849-ad22-4d1f-b7b8-98181dfc1653 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:18.210732 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-49b42849-ad22-4d1f-b7b8-98181dfc1653 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:18.211168 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-49b42849-ad22-4d1f-b7b8-98181dfc1653 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:18.212132 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-49b42849-ad22-4d1f-b7b8-98181dfc1653 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:18.212731 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-49b42849-ad22-4d1f-b7b8-98181dfc1653 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:18.213243 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-49b42849-ad22-4d1f-b7b8-98181dfc1653 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:18.357830 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-49b42849-ad22-4d1f-b7b8-98181dfc1653 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:18.369436 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-49b42849-ad22-4d1f-b7b8-98181dfc1653 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.174129 Sep 06 21:16:18.370186 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 196/390] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:18 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:19.160977 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-41a37813-40f1-4183-a6f0-791cbe1f7a6b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-562268280", "imageRef": "8b4a7612-517c-4711-8637-36b221338f65", "flavorRef": "452"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:16:19.217084 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-41a37813-40f1-4183-a6f0-791cbe1f7a6b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] validate_networks() for None {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 21:16:19.393729 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-227fa7f6-7a8c-484f-8025-5137aa5b9bfb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:19.394388 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-227fa7f6-7a8c-484f-8025-5137aa5b9bfb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:19.396822 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=36 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:19.402830 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-227fa7f6-7a8c-484f-8025-5137aa5b9bfb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:19.403346 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-227fa7f6-7a8c-484f-8025-5137aa5b9bfb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:19.403941 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-227fa7f6-7a8c-484f-8025-5137aa5b9bfb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:19.404648 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-227fa7f6-7a8c-484f-8025-5137aa5b9bfb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:19.405679 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-227fa7f6-7a8c-484f-8025-5137aa5b9bfb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:19.406156 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-227fa7f6-7a8c-484f-8025-5137aa5b9bfb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:19.553855 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-227fa7f6-7a8c-484f-8025-5137aa5b9bfb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:19.562187 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-227fa7f6-7a8c-484f-8025-5137aa5b9bfb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1521 microversion: 2.1 time: 0.172508 Sep 06 21:16:19.562866 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 197/391] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:19 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:19.745275 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-41a37813-40f1-4183-a6f0-791cbe1f7a6b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 21:16:19.745695 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-41a37813-40f1-4183-a6f0-791cbe1f7a6b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 21:16:19.746191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-41a37813-40f1-4183-a6f0-791cbe1f7a6b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 21:16:19.746804 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-41a37813-40f1-4183-a6f0-791cbe1f7a6b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 21:16:19.747401 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-41a37813-40f1-4183-a6f0-791cbe1f7a6b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 21:16:19.759911 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41a37813-40f1-4183-a6f0-791cbe1f7a6b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:19.760601 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41a37813-40f1-4183-a6f0-791cbe1f7a6b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:19.761356 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41a37813-40f1-4183-a6f0-791cbe1f7a6b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:19.762296 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41a37813-40f1-4183-a6f0-791cbe1f7a6b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:19.762969 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41a37813-40f1-4183-a6f0-791cbe1f7a6b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:19.763512 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41a37813-40f1-4183-a6f0-791cbe1f7a6b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:19.782224 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-41a37813-40f1-4183-a6f0-791cbe1f7a6b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Getting quotas for project acf9183eeeef40f7a99a49d0abfeffa6. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:16:19.787362 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-41a37813-40f1-4183-a6f0-791cbe1f7a6b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Getting quotas for user 8dd7bb424a25489db00059483f558b9a and project acf9183eeeef40f7a99a49d0abfeffa6. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:16:19.799913 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-41a37813-40f1-4183-a6f0-791cbe1f7a6b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 21:16:19.802271 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-41a37813-40f1-4183-a6f0-791cbe1f7a6b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8b4a7612-517c-4711-8637-36b221338f65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 21:16:19.847932 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-41a37813-40f1-4183-a6f0-791cbe1f7a6b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.693240 Sep 06 21:16:19.848885 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 195/392] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Sep 6 21:16:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 21:16:19.860628 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b04f9e1f-8e1e-4b7f-bf42-e361a72bcd3d tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:19.861248 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b04f9e1f-8e1e-4b7f-bf42-e361a72bcd3d tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:19.920491 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b04f9e1f-8e1e-4b7f-bf42-e361a72bcd3d tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7bb424a25489db00059483f558b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf9183eeeef40f7a99a49d0abfeffa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:19.928203 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b04f9e1f-8e1e-4b7f-bf42-e361a72bcd3d tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af" status: 200 len: 1214 microversion: 2.1 time: 0.072138 Sep 06 21:16:19.928800 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 198/393] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:19 2022] GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:20.262633 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4358efda-83a0-441e-aab1-7110ed002967 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-593505418", "imageRef": "8b4a7612-517c-4711-8637-36b221338f65", "flavorRef": "452", "networks": [{"uuid": "1040fd1e-1111-4899-86bc-abf763096bc8"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:16:20.271409 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:20.329426 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-4358efda-83a0-441e-aab1-7110ed002967 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] validate_networks() for [('1040fd1e-1111-4899-86bc-abf763096bc8', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 21:16:20.587896 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-167a513a-db8e-4a13-83d5-55d928665b0a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:20.589420 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-167a513a-db8e-4a13-83d5-55d928665b0a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:20.602529 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-167a513a-db8e-4a13-83d5-55d928665b0a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:20.603034 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-167a513a-db8e-4a13-83d5-55d928665b0a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:20.603549 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-167a513a-db8e-4a13-83d5-55d928665b0a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:20.604458 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-167a513a-db8e-4a13-83d5-55d928665b0a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:20.605172 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-167a513a-db8e-4a13-83d5-55d928665b0a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:20.605535 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-167a513a-db8e-4a13-83d5-55d928665b0a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:20.703512 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-4358efda-83a0-441e-aab1-7110ed002967 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 21:16:20.704251 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-4358efda-83a0-441e-aab1-7110ed002967 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 21:16:20.704949 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-4358efda-83a0-441e-aab1-7110ed002967 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 21:16:20.705419 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-4358efda-83a0-441e-aab1-7110ed002967 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 21:16:20.705886 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-4358efda-83a0-441e-aab1-7110ed002967 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 21:16:20.715355 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4358efda-83a0-441e-aab1-7110ed002967 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:20.716002 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4358efda-83a0-441e-aab1-7110ed002967 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:20.716433 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4358efda-83a0-441e-aab1-7110ed002967 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:20.717186 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4358efda-83a0-441e-aab1-7110ed002967 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:20.717745 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4358efda-83a0-441e-aab1-7110ed002967 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:20.718260 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4358efda-83a0-441e-aab1-7110ed002967 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:20.741019 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-4358efda-83a0-441e-aab1-7110ed002967 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Getting quotas for project 3c0901a228de4c59bc0e999f55bc1e08. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:16:20.746502 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-4358efda-83a0-441e-aab1-7110ed002967 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Getting quotas for user 71e0c39501bf48c2a63257a4cf75def1 and project 3c0901a228de4c59bc0e999f55bc1e08. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:16:20.759284 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4358efda-83a0-441e-aab1-7110ed002967 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 21:16:20.760560 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-167a513a-db8e-4a13-83d5-55d928665b0a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:20.761595 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4358efda-83a0-441e-aab1-7110ed002967 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8b4a7612-517c-4711-8637-36b221338f65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 21:16:20.770450 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-167a513a-db8e-4a13-83d5-55d928665b0a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1501 microversion: 2.1 time: 0.187602 Sep 06 21:16:20.771073 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 199/394] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:20 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1501 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:16:20.794639 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fbba360b-d270-404d-8288-673a4dd02891 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:20.795374 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fbba360b-d270-404d-8288-673a4dd02891 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:20.803344 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbba360b-d270-404d-8288-673a4dd02891 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:20.803818 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbba360b-d270-404d-8288-673a4dd02891 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:20.804253 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbba360b-d270-404d-8288-673a4dd02891 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:20.804991 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbba360b-d270-404d-8288-673a4dd02891 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:20.805438 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbba360b-d270-404d-8288-673a4dd02891 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:20.805861 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fbba360b-d270-404d-8288-673a4dd02891 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:20.814320 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4358efda-83a0-441e-aab1-7110ed002967 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555557 Sep 06 21:16:20.815133 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 196/395] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Sep 6 21:16:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 21:16:20.829977 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-22a0ddc7-c0f5-4151-888b-fc210845dd6e tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:20.836121 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-22a0ddc7-c0f5-4151-888b-fc210845dd6e tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:20.890999 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-22a0ddc7-c0f5-4151-888b-fc210845dd6e tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:20.904068 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-22a0ddc7-c0f5-4151-888b-fc210845dd6e tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2" status: 200 len: 1218 microversion: 2.1 time: 0.076373 Sep 06 21:16:20.919817 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 197/396] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:20 2022] GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:20.952230 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-77672ca4-50e9-4d3a-9bd9-878d76d1dd8b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:20.952886 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-77672ca4-50e9-4d3a-9bd9-878d76d1dd8b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:20.960011 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77672ca4-50e9-4d3a-9bd9-878d76d1dd8b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:20.960397 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77672ca4-50e9-4d3a-9bd9-878d76d1dd8b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:20.962158 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77672ca4-50e9-4d3a-9bd9-878d76d1dd8b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:20.963008 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77672ca4-50e9-4d3a-9bd9-878d76d1dd8b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:20.963469 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77672ca4-50e9-4d3a-9bd9-878d76d1dd8b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:20.963887 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77672ca4-50e9-4d3a-9bd9-878d76d1dd8b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:20.984265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-fbba360b-d270-404d-8288-673a4dd02891 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:20.994126 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fbba360b-d270-404d-8288-673a4dd02891 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1515 microversion: 2.1 time: 0.203715 Sep 06 21:16:20.995107 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 200/397] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:20 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1515 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:16:21.037117 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-77672ca4-50e9-4d3a-9bd9-878d76d1dd8b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7bb424a25489db00059483f558b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf9183eeeef40f7a99a49d0abfeffa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:21.041299 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:21.051608 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-77672ca4-50e9-4d3a-9bd9-878d76d1dd8b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af" status: 200 len: 1266 microversion: 2.1 time: 0.103435 Sep 06 21:16:21.052434 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 198/398] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:20 2022] GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:16:21.069197 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-85254747-b8cd-4355-97d6-fca1977771a6 tempest-VolumesTestJSON-2133315537 tempest-VolumesTestJSON-2133315537-project] Calling method '.version_select at 0x7f04ce6d0a60>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:21.127940 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-85254747-b8cd-4355-97d6-fca1977771a6 tempest-VolumesTestJSON-2133315537 tempest-VolumesTestJSON-2133315537-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/6d24d145-38ee-4073-b3c6-b8af87c85f04" status: 200 len: 350 microversion: 2.1 time: 0.062379 Sep 06 21:16:21.128830 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 201/399] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Sep 6 21:16:21 2022] GET /compute/v2.1/os-volumes/6d24d145-38ee-4073-b3c6-b8af87c85f04 => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:16:21.142953 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3690edff-1195-48ad-8ef0-fc2755c14844 tempest-VolumesTestJSON-2133315537 tempest-VolumesTestJSON-2133315537-project] Calling method '.version_select at 0x7f04ce7595e0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:21.328010 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3690edff-1195-48ad-8ef0-fc2755c14844 tempest-VolumesTestJSON-2133315537 tempest-VolumesTestJSON-2133315537-project] 10.222.0.79 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.189181 Sep 06 21:16:21.328725 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 199/400] 10.222.0.79 () {58 vars in 1134 bytes} [Tue Sep 6 21:16:21 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:21.344271 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cd1aed67-3c1b-4203-a842-acb6a01c3eb5 tempest-VolumesTestJSON-2133315537 tempest-VolumesTestJSON-2133315537-project] Calling method '.version_select at 0x7f04ce6d09d0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:21.451651 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cd1aed67-3c1b-4203-a842-acb6a01c3eb5 tempest-VolumesTestJSON-2133315537 tempest-VolumesTestJSON-2133315537-project] 10.222.0.79 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.112098 Sep 06 21:16:21.452876 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 202/401] 10.222.0.79 () {58 vars in 1149 bytes} [Tue Sep 6 21:16:21 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:16:21.468532 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2f7716b9-1215-4721-b0b3-e0a1eb4990ac tempest-VolumesTestJSON-2133315537 tempest-VolumesTestJSON-2133315537-project] Calling method '.version_select at 0x7f04ce6ecee0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:21.572689 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2f7716b9-1215-4721-b0b3-e0a1eb4990ac tempest-VolumesTestJSON-2133315537 tempest-VolumesTestJSON-2133315537-project] 10.222.0.79 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.108593 Sep 06 21:16:21.573269 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 200/402] 10.222.0.79 () {58 vars in 1134 bytes} [Tue Sep 6 21:16:21 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:21.590670 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1fa9083f-547d-4e58-a57f-92874b7999de tempest-VolumesTestJSON-2133315537 tempest-VolumesTestJSON-2133315537-project] Calling method '.version_select at 0x7f04ce6daca0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:21.682575 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1fa9083f-547d-4e58-a57f-92874b7999de tempest-VolumesTestJSON-2133315537 tempest-VolumesTestJSON-2133315537-project] 10.222.0.79 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.095821 Sep 06 21:16:21.683186 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 203/403] 10.222.0.79 () {58 vars in 1167 bytes} [Tue Sep 6 21:16:21 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:16:21.697114 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aeac7722-a8a5-44e4-a1bc-1841857e04a4 tempest-VolumesTestJSON-2133315537 tempest-VolumesTestJSON-2133315537-project] Calling method '.version_select at 0x7f04ce6f1d30>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:21.779143 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-aeac7722-a8a5-44e4-a1bc-1841857e04a4 tempest-VolumesTestJSON-2133315537 tempest-VolumesTestJSON-2133315537-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.085835 Sep 06 21:16:21.779635 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 201/404] 10.222.0.79 () {58 vars in 1170 bytes} [Tue Sep 6 21:16:21 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 21:16:21.795718 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-90bc1dca-7484-483d-a373-e856e80ceba5 tempest-VolumesTestJSON-2133315537 tempest-VolumesTestJSON-2133315537-project] Calling method '.version_select at 0x7f04ce79f550>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:21.887357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-90bc1dca-7484-483d-a373-e856e80ceba5 tempest-VolumesTestJSON-2133315537 tempest-VolumesTestJSON-2133315537-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.095778 Sep 06 21:16:21.888294 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 204/405] 10.222.0.79 () {58 vars in 1155 bytes} [Tue Sep 6 21:16:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:21.902351 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-99926c94-0dfe-4fa1-937d-346f8df063f1 tempest-VolumesTestJSON-2133315537 tempest-VolumesTestJSON-2133315537-project] Calling method '.version_select at 0x7f04cea8fee0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:21.927632 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-744a0651-e7de-424f-9256-8a75afb415ee tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:21.928237 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-744a0651-e7de-424f-9256-8a75afb415ee tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:21.934756 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-744a0651-e7de-424f-9256-8a75afb415ee tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:21.935445 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-744a0651-e7de-424f-9256-8a75afb415ee tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:21.936025 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-744a0651-e7de-424f-9256-8a75afb415ee tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:21.936919 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-744a0651-e7de-424f-9256-8a75afb415ee tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:21.937360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-744a0651-e7de-424f-9256-8a75afb415ee tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:21.937771 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-744a0651-e7de-424f-9256-8a75afb415ee tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:21.942623 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:21.995215 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-99926c94-0dfe-4fa1-937d-346f8df063f1 tempest-VolumesTestJSON-2133315537 tempest-VolumesTestJSON-2133315537-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.096565 Sep 06 21:16:21.996401 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 202/406] 10.222.0.79 () {58 vars in 1188 bytes} [Tue Sep 6 21:16:21 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:16:22.011052 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6f3c638a-0d72-4060-84e0-c817bf4522a8 tempest-VolumesTestJSON-2133315537 tempest-VolumesTestJSON-2133315537-project] Calling method '.version_select at 0x7f04cea95160>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:22.014807 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-744a0651-e7de-424f-9256-8a75afb415ee tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:22.024479 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-744a0651-e7de-424f-9256-8a75afb415ee tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2" status: 200 len: 1270 microversion: 2.1 time: 0.100921 Sep 06 21:16:22.025357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 205/407] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:21 2022] GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 => generated 1270 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:22.076962 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6892b66d-8243-408b-854d-5e5cd26cdc8b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:22.077762 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6892b66d-8243-408b-854d-5e5cd26cdc8b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:22.084488 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6892b66d-8243-408b-854d-5e5cd26cdc8b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:22.085018 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6892b66d-8243-408b-854d-5e5cd26cdc8b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:22.085452 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6892b66d-8243-408b-854d-5e5cd26cdc8b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:22.086153 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6892b66d-8243-408b-854d-5e5cd26cdc8b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:22.086601 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6892b66d-8243-408b-854d-5e5cd26cdc8b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:22.087020 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6892b66d-8243-408b-854d-5e5cd26cdc8b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:22.103131 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6f3c638a-0d72-4060-84e0-c817bf4522a8 tempest-VolumesTestJSON-2133315537 tempest-VolumesTestJSON-2133315537-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.096632 Sep 06 21:16:22.104133 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 203/408] 10.222.0.79 () {58 vars in 1155 bytes} [Tue Sep 6 21:16:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:16:22.179460 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6892b66d-8243-408b-854d-5e5cd26cdc8b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7bb424a25489db00059483f558b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf9183eeeef40f7a99a49d0abfeffa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:22.192420 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6892b66d-8243-408b-854d-5e5cd26cdc8b tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af" status: 200 len: 1272 microversion: 2.1 time: 0.120208 Sep 06 21:16:22.193262 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 206/409] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:22 2022] GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af => generated 1272 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:16:23.050990 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f1df27a1-145f-48b7-bc66-7332465ed4d6 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:23.051600 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f1df27a1-145f-48b7-bc66-7332465ed4d6 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:23.060403 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1df27a1-145f-48b7-bc66-7332465ed4d6 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:23.060926 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1df27a1-145f-48b7-bc66-7332465ed4d6 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:23.061360 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1df27a1-145f-48b7-bc66-7332465ed4d6 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:23.062067 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1df27a1-145f-48b7-bc66-7332465ed4d6 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:23.062528 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1df27a1-145f-48b7-bc66-7332465ed4d6 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:23.062949 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1df27a1-145f-48b7-bc66-7332465ed4d6 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:23.184591 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f1df27a1-145f-48b7-bc66-7332465ed4d6 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:23.193989 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f1df27a1-145f-48b7-bc66-7332465ed4d6 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2" status: 200 len: 1276 microversion: 2.1 time: 0.147884 Sep 06 21:16:23.194651 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 204/410] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:23 2022] GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 => generated 1276 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:23.220924 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-62ffb91a-2003-4b73-8063-341cba0df992 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:23.221792 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-62ffb91a-2003-4b73-8063-341cba0df992 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:23.228049 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62ffb91a-2003-4b73-8063-341cba0df992 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:23.228619 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62ffb91a-2003-4b73-8063-341cba0df992 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:23.229135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62ffb91a-2003-4b73-8063-341cba0df992 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:23.229901 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62ffb91a-2003-4b73-8063-341cba0df992 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:23.230484 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62ffb91a-2003-4b73-8063-341cba0df992 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:23.230981 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62ffb91a-2003-4b73-8063-341cba0df992 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:23.471683 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-350e9a4c-2202-486e-bd64-c6c846cfaf92 req-c8899a4c-127b-4056-8285-f62c378c3a77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feb89148-4abf-4f2e-aa7b-422bfa0111af", "tag": "cf251011-5971-41a7-ac49-c0dd74d4dbf6"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:16:23.483393 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-350e9a4c-2202-486e-bd64-c6c846cfaf92 req-c8899a4c-127b-4056-8285-f62c378c3a77 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:23.484179 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-350e9a4c-2202-486e-bd64-c6c846cfaf92 req-c8899a4c-127b-4056-8285-f62c378c3a77 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:23.484814 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-350e9a4c-2202-486e-bd64-c6c846cfaf92 req-c8899a4c-127b-4056-8285-f62c378c3a77 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:23.499416 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-350e9a4c-2202-486e-bd64-c6c846cfaf92 req-c8899a4c-127b-4056-8285-f62c378c3a77 service nova] Creating event network-changed:cf251011-5971-41a7-ac49-c0dd74d4dbf6 for instance feb89148-4abf-4f2e-aa7b-422bfa0111af on hv-cinder-74915 Sep 06 21:16:23.506534 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-350e9a4c-2202-486e-bd64-c6c846cfaf92 req-c8899a4c-127b-4056-8285-f62c378c3a77 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039956 Sep 06 21:16:23.508467 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 205/411] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 21:16:23.569655 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fab6c5da-cbea-48b6-b745-28d99a262da0 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:16:23.571950 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fab6c5da-cbea-48b6-b745-28d99a262da0 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:23.578590 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fab6c5da-cbea-48b6-b745-28d99a262da0 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:23.579131 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fab6c5da-cbea-48b6-b745-28d99a262da0 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:23.579572 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fab6c5da-cbea-48b6-b745-28d99a262da0 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:23.580281 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fab6c5da-cbea-48b6-b745-28d99a262da0 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:23.581018 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fab6c5da-cbea-48b6-b745-28d99a262da0 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:23.581320 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fab6c5da-cbea-48b6-b745-28d99a262da0 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:23.608552 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-fab6c5da-cbea-48b6-b745-28d99a262da0 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lazy-loading 'flavor' on Instance uuid e4f062bd-6aa2-4c00-86a3-7ddc003c1713 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:16:23.665425 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-62ffb91a-2003-4b73-8063-341cba0df992 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7bb424a25489db00059483f558b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf9183eeeef40f7a99a49d0abfeffa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:23.678403 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-62ffb91a-2003-4b73-8063-341cba0df992 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af" status: 200 len: 1314 microversion: 2.1 time: 0.462473 Sep 06 21:16:23.680239 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 207/412] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:23 2022] GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:23.748572 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fab6c5da-cbea-48b6-b745-28d99a262da0 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "POST /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713/action" status: 200 len: 32 microversion: 2.1 time: 0.184762 Sep 06 21:16:23.749553 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 206/413] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Sep 6 21:16:23 2022] POST /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713/action => generated 32 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 21:16:23.765206 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a8edf91b-6d2d-40ad-9a7d-d46310b7189a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:23.766380 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a8edf91b-6d2d-40ad-9a7d-d46310b7189a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:23.776037 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8edf91b-6d2d-40ad-9a7d-d46310b7189a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:23.776847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8edf91b-6d2d-40ad-9a7d-d46310b7189a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:23.777476 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8edf91b-6d2d-40ad-9a7d-d46310b7189a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:23.778268 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8edf91b-6d2d-40ad-9a7d-d46310b7189a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:23.778722 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8edf91b-6d2d-40ad-9a7d-d46310b7189a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:23.779143 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8edf91b-6d2d-40ad-9a7d-d46310b7189a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:24.012208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a8edf91b-6d2d-40ad-9a7d-d46310b7189a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:24.021198 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a8edf91b-6d2d-40ad-9a7d-d46310b7189a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1521 microversion: 2.1 time: 0.263783 Sep 06 21:16:24.022097 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 208/414] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:23 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:24.220051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c4b03e62-456b-4d62-8fbc-d16874b7eb80 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:24.221982 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c4b03e62-456b-4d62-8fbc-d16874b7eb80 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:24.230655 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4b03e62-456b-4d62-8fbc-d16874b7eb80 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:24.231699 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4b03e62-456b-4d62-8fbc-d16874b7eb80 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:24.232299 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4b03e62-456b-4d62-8fbc-d16874b7eb80 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:24.233701 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4b03e62-456b-4d62-8fbc-d16874b7eb80 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:24.234933 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4b03e62-456b-4d62-8fbc-d16874b7eb80 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:24.235326 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4b03e62-456b-4d62-8fbc-d16874b7eb80 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:24.541992 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c4b03e62-456b-4d62-8fbc-d16874b7eb80 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:24.553905 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c4b03e62-456b-4d62-8fbc-d16874b7eb80 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2" status: 200 len: 1318 microversion: 2.1 time: 0.339270 Sep 06 21:16:24.578575 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 207/415] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:24 2022] GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:24.703733 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9494b5ef-335e-4906-bb71-6ef3ca2a6acb tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:24.704354 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9494b5ef-335e-4906-bb71-6ef3ca2a6acb tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:24.711432 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9494b5ef-335e-4906-bb71-6ef3ca2a6acb tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:24.711937 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9494b5ef-335e-4906-bb71-6ef3ca2a6acb tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:24.712365 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9494b5ef-335e-4906-bb71-6ef3ca2a6acb tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:24.713069 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9494b5ef-335e-4906-bb71-6ef3ca2a6acb tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:24.713510 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9494b5ef-335e-4906-bb71-6ef3ca2a6acb tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:24.714133 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9494b5ef-335e-4906-bb71-6ef3ca2a6acb tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:24.921608 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9494b5ef-335e-4906-bb71-6ef3ca2a6acb tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7bb424a25489db00059483f558b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf9183eeeef40f7a99a49d0abfeffa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:24.932052 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9494b5ef-335e-4906-bb71-6ef3ca2a6acb tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af" status: 200 len: 1314 microversion: 2.1 time: 0.232024 Sep 06 21:16:24.932886 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 209/416] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:24 2022] GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:25.004185 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-50734d47-bfa5-41a0-ae57-8a713e1972f3 req-d340485d-8fcc-47cd-9477-2abfd8602782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8213fe3f-e8c0-4919-b1d8-02f6c049b0d2", "tag": "1795cb49-18af-42b5-8214-76d1f8210b66"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:16:25.014708 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-50734d47-bfa5-41a0-ae57-8a713e1972f3 req-d340485d-8fcc-47cd-9477-2abfd8602782 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:25.015219 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-50734d47-bfa5-41a0-ae57-8a713e1972f3 req-d340485d-8fcc-47cd-9477-2abfd8602782 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:25.015635 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-50734d47-bfa5-41a0-ae57-8a713e1972f3 req-d340485d-8fcc-47cd-9477-2abfd8602782 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:25.026370 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-50734d47-bfa5-41a0-ae57-8a713e1972f3 req-d340485d-8fcc-47cd-9477-2abfd8602782 service nova] Creating event network-changed:1795cb49-18af-42b5-8214-76d1f8210b66 for instance 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 on hv-cinder-74915 Sep 06 21:16:25.031323 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-50734d47-bfa5-41a0-ae57-8a713e1972f3 req-d340485d-8fcc-47cd-9477-2abfd8602782 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030847 Sep 06 21:16:25.031902 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 208/417] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:16:25.046092 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-005aa4e8-27ce-4c72-b570-ebe9be3c2608 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:25.046706 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-005aa4e8-27ce-4c72-b570-ebe9be3c2608 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:25.053562 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-005aa4e8-27ce-4c72-b570-ebe9be3c2608 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:25.054049 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-005aa4e8-27ce-4c72-b570-ebe9be3c2608 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:25.054476 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-005aa4e8-27ce-4c72-b570-ebe9be3c2608 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:25.055172 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-005aa4e8-27ce-4c72-b570-ebe9be3c2608 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:25.055761 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-005aa4e8-27ce-4c72-b570-ebe9be3c2608 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:25.056022 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-005aa4e8-27ce-4c72-b570-ebe9be3c2608 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:25.192115 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-005aa4e8-27ce-4c72-b570-ebe9be3c2608 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:25.200273 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-005aa4e8-27ce-4c72-b570-ebe9be3c2608 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1521 microversion: 2.1 time: 0.158212 Sep 06 21:16:25.200928 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 210/418] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:25 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:25.579411 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c144c8b2-015a-4e9d-8683-14b9b0682937 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:25.580111 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c144c8b2-015a-4e9d-8683-14b9b0682937 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:25.587050 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c144c8b2-015a-4e9d-8683-14b9b0682937 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:25.587927 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c144c8b2-015a-4e9d-8683-14b9b0682937 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:25.588376 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c144c8b2-015a-4e9d-8683-14b9b0682937 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:25.589126 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c144c8b2-015a-4e9d-8683-14b9b0682937 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:25.589577 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c144c8b2-015a-4e9d-8683-14b9b0682937 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:25.589998 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c144c8b2-015a-4e9d-8683-14b9b0682937 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:25.738615 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c144c8b2-015a-4e9d-8683-14b9b0682937 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:25.747058 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c144c8b2-015a-4e9d-8683-14b9b0682937 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2" status: 200 len: 1318 microversion: 2.1 time: 0.171994 Sep 06 21:16:25.747814 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 209/419] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:25 2022] GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:25.956285 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0dba6302-bd9f-4f3c-b0da-db24cc2425b8 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:25.957065 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0dba6302-bd9f-4f3c-b0da-db24cc2425b8 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:25.964275 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0dba6302-bd9f-4f3c-b0da-db24cc2425b8 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:25.964852 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0dba6302-bd9f-4f3c-b0da-db24cc2425b8 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:25.965296 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0dba6302-bd9f-4f3c-b0da-db24cc2425b8 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:25.965981 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0dba6302-bd9f-4f3c-b0da-db24cc2425b8 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:25.966422 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0dba6302-bd9f-4f3c-b0da-db24cc2425b8 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:25.966905 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0dba6302-bd9f-4f3c-b0da-db24cc2425b8 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:26.105422 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0dba6302-bd9f-4f3c-b0da-db24cc2425b8 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7bb424a25489db00059483f558b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf9183eeeef40f7a99a49d0abfeffa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:26.114376 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0dba6302-bd9f-4f3c-b0da-db24cc2425b8 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af" status: 200 len: 1314 microversion: 2.1 time: 0.162247 Sep 06 21:16:26.114941 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 211/420] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:25 2022] GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:26.223619 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d878edea-ee00-4577-9006-fd388f574247 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:26.224218 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d878edea-ee00-4577-9006-fd388f574247 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:26.230688 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d878edea-ee00-4577-9006-fd388f574247 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:26.231177 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d878edea-ee00-4577-9006-fd388f574247 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:26.231595 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d878edea-ee00-4577-9006-fd388f574247 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:26.232285 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d878edea-ee00-4577-9006-fd388f574247 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:26.232757 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d878edea-ee00-4577-9006-fd388f574247 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:26.233183 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d878edea-ee00-4577-9006-fd388f574247 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:26.404235 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d878edea-ee00-4577-9006-fd388f574247 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:26.414110 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d878edea-ee00-4577-9006-fd388f574247 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1521 microversion: 2.1 time: 0.194381 Sep 06 21:16:26.414810 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 210/421] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:26 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:26.769986 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7e3a8f00-24dc-40a9-8452-210d2248d4bf tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:26.770691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7e3a8f00-24dc-40a9-8452-210d2248d4bf tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:26.777084 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e3a8f00-24dc-40a9-8452-210d2248d4bf tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:26.777562 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e3a8f00-24dc-40a9-8452-210d2248d4bf tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:26.777997 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e3a8f00-24dc-40a9-8452-210d2248d4bf tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:26.778688 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e3a8f00-24dc-40a9-8452-210d2248d4bf tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:26.779136 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e3a8f00-24dc-40a9-8452-210d2248d4bf tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:26.779557 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e3a8f00-24dc-40a9-8452-210d2248d4bf tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:26.920397 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7e3a8f00-24dc-40a9-8452-210d2248d4bf tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:26.929434 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7e3a8f00-24dc-40a9-8452-210d2248d4bf tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2" status: 200 len: 1318 microversion: 2.1 time: 0.163579 Sep 06 21:16:26.930245 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 212/422] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:26 2022] GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:27.137107 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-68d196da-7928-422d-bc67-a8a9ef8744d0 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:27.137686 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-68d196da-7928-422d-bc67-a8a9ef8744d0 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:27.143856 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68d196da-7928-422d-bc67-a8a9ef8744d0 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:27.144319 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68d196da-7928-422d-bc67-a8a9ef8744d0 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:27.144765 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68d196da-7928-422d-bc67-a8a9ef8744d0 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:27.145422 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68d196da-7928-422d-bc67-a8a9ef8744d0 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:27.145857 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68d196da-7928-422d-bc67-a8a9ef8744d0 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:27.146267 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68d196da-7928-422d-bc67-a8a9ef8744d0 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:27.431357 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-68d196da-7928-422d-bc67-a8a9ef8744d0 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7bb424a25489db00059483f558b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf9183eeeef40f7a99a49d0abfeffa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:27.438362 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e389b04a-e09b-48f4-b8f7-fcafdc03acfb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:27.438955 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e389b04a-e09b-48f4-b8f7-fcafdc03acfb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:27.446082 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e389b04a-e09b-48f4-b8f7-fcafdc03acfb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:27.446646 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e389b04a-e09b-48f4-b8f7-fcafdc03acfb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:27.447077 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e389b04a-e09b-48f4-b8f7-fcafdc03acfb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:27.447936 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e389b04a-e09b-48f4-b8f7-fcafdc03acfb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:27.448341 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-68d196da-7928-422d-bc67-a8a9ef8744d0 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af" status: 200 len: 1314 microversion: 2.1 time: 0.314781 Sep 06 21:16:27.448478 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e389b04a-e09b-48f4-b8f7-fcafdc03acfb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:27.458400 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e389b04a-e09b-48f4-b8f7-fcafdc03acfb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:27.458565 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 211/423] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:27 2022] GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:27.594246 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e389b04a-e09b-48f4-b8f7-fcafdc03acfb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:27.602326 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e389b04a-e09b-48f4-b8f7-fcafdc03acfb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1521 microversion: 2.1 time: 0.167761 Sep 06 21:16:27.605858 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 213/424] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:27 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:27.952889 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2fef9679-1099-4f13-bc70-b22633f30b67 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:27.953536 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2fef9679-1099-4f13-bc70-b22633f30b67 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:27.959626 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fef9679-1099-4f13-bc70-b22633f30b67 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:27.959980 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fef9679-1099-4f13-bc70-b22633f30b67 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:27.960406 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fef9679-1099-4f13-bc70-b22633f30b67 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:27.961130 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fef9679-1099-4f13-bc70-b22633f30b67 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:27.961569 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fef9679-1099-4f13-bc70-b22633f30b67 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:27.961982 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fef9679-1099-4f13-bc70-b22633f30b67 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:28.100349 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2fef9679-1099-4f13-bc70-b22633f30b67 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:28.109620 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2fef9679-1099-4f13-bc70-b22633f30b67 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2" status: 200 len: 1318 microversion: 2.1 time: 0.160689 Sep 06 21:16:28.110113 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 212/425] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:27 2022] GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:28.471904 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-01062977-9568-4d76-8c69-b6bafc2f28a3 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:28.472510 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-01062977-9568-4d76-8c69-b6bafc2f28a3 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:28.479517 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01062977-9568-4d76-8c69-b6bafc2f28a3 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:28.480011 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01062977-9568-4d76-8c69-b6bafc2f28a3 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:28.480432 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01062977-9568-4d76-8c69-b6bafc2f28a3 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:28.481185 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01062977-9568-4d76-8c69-b6bafc2f28a3 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:28.481620 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01062977-9568-4d76-8c69-b6bafc2f28a3 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:28.482006 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01062977-9568-4d76-8c69-b6bafc2f28a3 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:28.625639 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e48c410c-04a7-4a75-9a13-83b9c3516fd7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:28.626211 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e48c410c-04a7-4a75-9a13-83b9c3516fd7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:28.627333 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-01062977-9568-4d76-8c69-b6bafc2f28a3 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7bb424a25489db00059483f558b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf9183eeeef40f7a99a49d0abfeffa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:28.632441 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e48c410c-04a7-4a75-9a13-83b9c3516fd7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:28.632955 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e48c410c-04a7-4a75-9a13-83b9c3516fd7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:28.633387 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e48c410c-04a7-4a75-9a13-83b9c3516fd7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:28.634090 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e48c410c-04a7-4a75-9a13-83b9c3516fd7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:28.634514 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e48c410c-04a7-4a75-9a13-83b9c3516fd7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:28.634963 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e48c410c-04a7-4a75-9a13-83b9c3516fd7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:28.635819 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-01062977-9568-4d76-8c69-b6bafc2f28a3 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af" status: 200 len: 1314 microversion: 2.1 time: 0.168030 Sep 06 21:16:28.636505 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 214/426] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:28 2022] GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:28.782580 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e48c410c-04a7-4a75-9a13-83b9c3516fd7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:28.793860 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e48c410c-04a7-4a75-9a13-83b9c3516fd7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1521 microversion: 2.1 time: 0.172230 Sep 06 21:16:28.794509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 213/427] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:28 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:29.133811 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-94d21705-b35d-4c2b-a568-75c3616bf17e tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:29.134549 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-94d21705-b35d-4c2b-a568-75c3616bf17e tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:29.142596 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-94d21705-b35d-4c2b-a568-75c3616bf17e tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:29.143409 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-94d21705-b35d-4c2b-a568-75c3616bf17e tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:29.144429 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-94d21705-b35d-4c2b-a568-75c3616bf17e tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:29.153168 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-94d21705-b35d-4c2b-a568-75c3616bf17e tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:29.153804 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-94d21705-b35d-4c2b-a568-75c3616bf17e tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:29.153988 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-94d21705-b35d-4c2b-a568-75c3616bf17e tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:29.294560 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-94d21705-b35d-4c2b-a568-75c3616bf17e tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:29.302850 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-94d21705-b35d-4c2b-a568-75c3616bf17e tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2" status: 200 len: 1318 microversion: 2.1 time: 0.174097 Sep 06 21:16:29.303412 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 215/428] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:29 2022] GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:29.661886 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-42f782e7-151b-45e8-be78-f4562db99ee9 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:29.662513 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-42f782e7-151b-45e8-be78-f4562db99ee9 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:29.671378 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42f782e7-151b-45e8-be78-f4562db99ee9 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:29.671860 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42f782e7-151b-45e8-be78-f4562db99ee9 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:29.672323 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42f782e7-151b-45e8-be78-f4562db99ee9 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:29.673041 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42f782e7-151b-45e8-be78-f4562db99ee9 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:29.673488 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42f782e7-151b-45e8-be78-f4562db99ee9 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:29.674266 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42f782e7-151b-45e8-be78-f4562db99ee9 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:29.825631 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7dca8978-413e-4ff8-aa34-ef97fef95456 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:29.826366 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7dca8978-413e-4ff8-aa34-ef97fef95456 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:29.833075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7dca8978-413e-4ff8-aa34-ef97fef95456 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:29.833635 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7dca8978-413e-4ff8-aa34-ef97fef95456 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:29.834123 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7dca8978-413e-4ff8-aa34-ef97fef95456 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:29.835070 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7dca8978-413e-4ff8-aa34-ef97fef95456 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:29.835518 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7dca8978-413e-4ff8-aa34-ef97fef95456 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:29.835935 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7dca8978-413e-4ff8-aa34-ef97fef95456 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:29.836747 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-42f782e7-151b-45e8-be78-f4562db99ee9 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7bb424a25489db00059483f558b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf9183eeeef40f7a99a49d0abfeffa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:29.845120 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-42f782e7-151b-45e8-be78-f4562db99ee9 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af" status: 200 len: 1314 microversion: 2.1 time: 0.188962 Sep 06 21:16:29.845665 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 214/429] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:29 2022] GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:29.924641 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:29.984324 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7dca8978-413e-4ff8-aa34-ef97fef95456 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:29.992897 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7dca8978-413e-4ff8-aa34-ef97fef95456 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1521 microversion: 2.1 time: 0.171021 Sep 06 21:16:30.008464 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 216/430] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:29 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:30.325957 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2b33d00a-90d6-4ac3-8df5-1be3666ee888 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:30.326986 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2b33d00a-90d6-4ac3-8df5-1be3666ee888 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:30.334235 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b33d00a-90d6-4ac3-8df5-1be3666ee888 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:30.335012 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b33d00a-90d6-4ac3-8df5-1be3666ee888 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:30.335642 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b33d00a-90d6-4ac3-8df5-1be3666ee888 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:30.336582 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b33d00a-90d6-4ac3-8df5-1be3666ee888 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:30.337064 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b33d00a-90d6-4ac3-8df5-1be3666ee888 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:30.337575 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b33d00a-90d6-4ac3-8df5-1be3666ee888 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:30.736902 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:30.821243 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2b33d00a-90d6-4ac3-8df5-1be3666ee888 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:30.829372 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2b33d00a-90d6-4ac3-8df5-1be3666ee888 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2" status: 200 len: 1318 microversion: 2.1 time: 0.507241 Sep 06 21:16:30.841318 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 215/431] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:30 2022] GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 => generated 1318 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:30.868754 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-31e633ec-0efd-44f5-9667-abae5adba88c tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:30.869361 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-31e633ec-0efd-44f5-9667-abae5adba88c tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:30.876270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31e633ec-0efd-44f5-9667-abae5adba88c tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:30.876791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31e633ec-0efd-44f5-9667-abae5adba88c tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:30.877226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31e633ec-0efd-44f5-9667-abae5adba88c tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:30.877919 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31e633ec-0efd-44f5-9667-abae5adba88c tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:30.878364 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31e633ec-0efd-44f5-9667-abae5adba88c tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:30.878782 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31e633ec-0efd-44f5-9667-abae5adba88c tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:31.016340 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-42e98f04-df1e-4479-a587-ea629dd58171 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:31.016978 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-42e98f04-df1e-4479-a587-ea629dd58171 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:31.018921 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=14 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:31.021621 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-31e633ec-0efd-44f5-9667-abae5adba88c tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7bb424a25489db00059483f558b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf9183eeeef40f7a99a49d0abfeffa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:31.024528 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42e98f04-df1e-4479-a587-ea629dd58171 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:31.025041 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42e98f04-df1e-4479-a587-ea629dd58171 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:31.025475 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42e98f04-df1e-4479-a587-ea629dd58171 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:31.026172 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42e98f04-df1e-4479-a587-ea629dd58171 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:31.026632 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42e98f04-df1e-4479-a587-ea629dd58171 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:31.027053 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42e98f04-df1e-4479-a587-ea629dd58171 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:31.029751 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-31e633ec-0efd-44f5-9667-abae5adba88c tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af" status: 200 len: 1314 microversion: 2.1 time: 0.164996 Sep 06 21:16:31.030551 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 217/432] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:30 2022] GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:31.163982 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-42e98f04-df1e-4479-a587-ea629dd58171 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:31.172514 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-42e98f04-df1e-4479-a587-ea629dd58171 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1521 microversion: 2.1 time: 0.160287 Sep 06 21:16:31.173111 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 216/433] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:31 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:31.852966 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b0a382e6-9731-47dd-b41f-5e1b6ddf5eef tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:31.853595 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b0a382e6-9731-47dd-b41f-5e1b6ddf5eef tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:31.860135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0a382e6-9731-47dd-b41f-5e1b6ddf5eef tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:31.860620 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0a382e6-9731-47dd-b41f-5e1b6ddf5eef tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:31.861081 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0a382e6-9731-47dd-b41f-5e1b6ddf5eef tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:31.861794 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0a382e6-9731-47dd-b41f-5e1b6ddf5eef tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:31.862236 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0a382e6-9731-47dd-b41f-5e1b6ddf5eef tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:31.862661 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0a382e6-9731-47dd-b41f-5e1b6ddf5eef tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:32.002494 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b0a382e6-9731-47dd-b41f-5e1b6ddf5eef tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:32.010464 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b0a382e6-9731-47dd-b41f-5e1b6ddf5eef tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2" status: 200 len: 1318 microversion: 2.1 time: 0.161466 Sep 06 21:16:32.011237 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 218/434] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:31 2022] GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:32.056704 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d9f8b153-8e4f-4734-a721-f25679b3d379 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:32.057880 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d9f8b153-8e4f-4734-a721-f25679b3d379 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:32.068206 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d9f8b153-8e4f-4734-a721-f25679b3d379 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:32.069085 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d9f8b153-8e4f-4734-a721-f25679b3d379 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:32.069813 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d9f8b153-8e4f-4734-a721-f25679b3d379 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:32.070959 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d9f8b153-8e4f-4734-a721-f25679b3d379 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:32.071750 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d9f8b153-8e4f-4734-a721-f25679b3d379 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:32.072498 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d9f8b153-8e4f-4734-a721-f25679b3d379 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:32.107346 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-0885a965-4897-4ed7-9592-67d57e49b376 req-587f7c3d-c365-4d0a-a929-feb265d10b3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feb89148-4abf-4f2e-aa7b-422bfa0111af", "name": "network-vif-plugged", "status": "completed", "tag": "cf251011-5971-41a7-ac49-c0dd74d4dbf6"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:16:32.118410 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0885a965-4897-4ed7-9592-67d57e49b376 req-587f7c3d-c365-4d0a-a929-feb265d10b3b service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:32.118883 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0885a965-4897-4ed7-9592-67d57e49b376 req-587f7c3d-c365-4d0a-a929-feb265d10b3b service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:32.119311 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-0885a965-4897-4ed7-9592-67d57e49b376 req-587f7c3d-c365-4d0a-a929-feb265d10b3b service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:32.131726 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-0885a965-4897-4ed7-9592-67d57e49b376 req-587f7c3d-c365-4d0a-a929-feb265d10b3b service nova] Creating event network-vif-plugged:cf251011-5971-41a7-ac49-c0dd74d4dbf6 for instance feb89148-4abf-4f2e-aa7b-422bfa0111af on hv-cinder-74915 Sep 06 21:16:32.137283 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-0885a965-4897-4ed7-9592-67d57e49b376 req-587f7c3d-c365-4d0a-a929-feb265d10b3b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033894 Sep 06 21:16:32.137851 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 219/435] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:16:32.196217 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-88f142e5-85b8-422b-a656-36426ead83e7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:32.196950 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-88f142e5-85b8-422b-a656-36426ead83e7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:32.203770 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88f142e5-85b8-422b-a656-36426ead83e7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:32.204253 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88f142e5-85b8-422b-a656-36426ead83e7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:32.204684 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88f142e5-85b8-422b-a656-36426ead83e7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:32.205436 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88f142e5-85b8-422b-a656-36426ead83e7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:32.205871 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88f142e5-85b8-422b-a656-36426ead83e7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:32.206295 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-88f142e5-85b8-422b-a656-36426ead83e7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:32.221049 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d9f8b153-8e4f-4734-a721-f25679b3d379 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7bb424a25489db00059483f558b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf9183eeeef40f7a99a49d0abfeffa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:32.228900 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d9f8b153-8e4f-4734-a721-f25679b3d379 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af" status: 200 len: 1314 microversion: 2.1 time: 0.179769 Sep 06 21:16:32.229494 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 217/436] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:32 2022] GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:32.365061 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-88f142e5-85b8-422b-a656-36426ead83e7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:32.373573 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-88f142e5-85b8-422b-a656-36426ead83e7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1521 microversion: 2.1 time: 0.181726 Sep 06 21:16:32.374147 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 220/437] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:32 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:33.035207 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1dcc4481-778e-42e2-a642-d5a2d7ab1ddb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:33.035884 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1dcc4481-778e-42e2-a642-d5a2d7ab1ddb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:33.042368 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1dcc4481-778e-42e2-a642-d5a2d7ab1ddb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:33.042976 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1dcc4481-778e-42e2-a642-d5a2d7ab1ddb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:33.043598 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1dcc4481-778e-42e2-a642-d5a2d7ab1ddb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:33.044355 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1dcc4481-778e-42e2-a642-d5a2d7ab1ddb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:33.044856 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1dcc4481-778e-42e2-a642-d5a2d7ab1ddb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:33.045279 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1dcc4481-778e-42e2-a642-d5a2d7ab1ddb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:33.184205 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1dcc4481-778e-42e2-a642-d5a2d7ab1ddb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:33.192426 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1dcc4481-778e-42e2-a642-d5a2d7ab1ddb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2" status: 200 len: 1318 microversion: 2.1 time: 0.162715 Sep 06 21:16:33.193255 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 218/438] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:33 2022] GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:33.254555 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ad036b9b-ba54-46ea-b1ec-ef1ce7d37d25 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:33.255595 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ad036b9b-ba54-46ea-b1ec-ef1ce7d37d25 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:33.265494 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad036b9b-ba54-46ea-b1ec-ef1ce7d37d25 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:33.266025 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad036b9b-ba54-46ea-b1ec-ef1ce7d37d25 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:33.266693 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad036b9b-ba54-46ea-b1ec-ef1ce7d37d25 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:33.267357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad036b9b-ba54-46ea-b1ec-ef1ce7d37d25 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:33.267781 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad036b9b-ba54-46ea-b1ec-ef1ce7d37d25 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:33.268233 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad036b9b-ba54-46ea-b1ec-ef1ce7d37d25 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:33.399146 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e00cbed4-afcd-4ee6-8f52-129dade37237 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:33.399784 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e00cbed4-afcd-4ee6-8f52-129dade37237 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:33.407460 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e00cbed4-afcd-4ee6-8f52-129dade37237 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:33.408129 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e00cbed4-afcd-4ee6-8f52-129dade37237 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:33.408771 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e00cbed4-afcd-4ee6-8f52-129dade37237 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:33.409632 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ad036b9b-ba54-46ea-b1ec-ef1ce7d37d25 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7bb424a25489db00059483f558b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf9183eeeef40f7a99a49d0abfeffa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:33.409766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e00cbed4-afcd-4ee6-8f52-129dade37237 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:33.410336 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e00cbed4-afcd-4ee6-8f52-129dade37237 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:33.410905 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e00cbed4-afcd-4ee6-8f52-129dade37237 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:33.417999 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ad036b9b-ba54-46ea-b1ec-ef1ce7d37d25 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af" status: 200 len: 1314 microversion: 2.1 time: 0.169708 Sep 06 21:16:33.418495 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 221/439] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:33 2022] GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:33.543166 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e00cbed4-afcd-4ee6-8f52-129dade37237 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:33.546649 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:33.552035 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e00cbed4-afcd-4ee6-8f52-129dade37237 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1521 microversion: 2.1 time: 0.158337 Sep 06 21:16:33.552584 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 219/440] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:33 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:16:34.216131 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-095b2549-5f38-459d-8894-5f2521784e26 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:34.216648 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-095b2549-5f38-459d-8894-5f2521784e26 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:34.223264 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-095b2549-5f38-459d-8894-5f2521784e26 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:34.223733 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-095b2549-5f38-459d-8894-5f2521784e26 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:34.224181 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-095b2549-5f38-459d-8894-5f2521784e26 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:34.224893 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-095b2549-5f38-459d-8894-5f2521784e26 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:34.225342 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-095b2549-5f38-459d-8894-5f2521784e26 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:34.225747 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-095b2549-5f38-459d-8894-5f2521784e26 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:34.245028 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:34.372098 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-095b2549-5f38-459d-8894-5f2521784e26 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:34.381608 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-095b2549-5f38-459d-8894-5f2521784e26 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2" status: 200 len: 1318 microversion: 2.1 time: 0.169680 Sep 06 21:16:34.382184 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 222/441] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:34 2022] GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:34.442104 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0c07a2f2-82c2-4aeb-b95d-12b217673170 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:34.442844 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0c07a2f2-82c2-4aeb-b95d-12b217673170 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:34.450624 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c07a2f2-82c2-4aeb-b95d-12b217673170 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:34.451219 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c07a2f2-82c2-4aeb-b95d-12b217673170 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:34.451715 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c07a2f2-82c2-4aeb-b95d-12b217673170 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:34.452475 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c07a2f2-82c2-4aeb-b95d-12b217673170 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:34.453012 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c07a2f2-82c2-4aeb-b95d-12b217673170 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:34.453495 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c07a2f2-82c2-4aeb-b95d-12b217673170 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:34.575584 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c7571f24-4358-4791-9b6c-fc53cc9727ae tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:34.576183 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c7571f24-4358-4791-9b6c-fc53cc9727ae tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:34.582519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7571f24-4358-4791-9b6c-fc53cc9727ae tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:34.583303 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7571f24-4358-4791-9b6c-fc53cc9727ae tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:34.583730 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7571f24-4358-4791-9b6c-fc53cc9727ae tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:34.584492 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7571f24-4358-4791-9b6c-fc53cc9727ae tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:34.585118 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7571f24-4358-4791-9b6c-fc53cc9727ae tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:34.585532 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7571f24-4358-4791-9b6c-fc53cc9727ae tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:34.594293 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0c07a2f2-82c2-4aeb-b95d-12b217673170 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7bb424a25489db00059483f558b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf9183eeeef40f7a99a49d0abfeffa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:34.601818 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0c07a2f2-82c2-4aeb-b95d-12b217673170 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af" status: 200 len: 1314 microversion: 2.1 time: 0.163988 Sep 06 21:16:34.602707 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 220/442] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:34 2022] GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:34.732882 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c7571f24-4358-4791-9b6c-fc53cc9727ae tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:34.740990 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c7571f24-4358-4791-9b6c-fc53cc9727ae tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1521 microversion: 2.1 time: 0.169381 Sep 06 21:16:34.741625 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 223/443] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:34 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:16:35.405049 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-40bfdc59-9fa0-4e74-ae10-da7bbd172cca tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:35.405719 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-40bfdc59-9fa0-4e74-ae10-da7bbd172cca tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:35.411764 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40bfdc59-9fa0-4e74-ae10-da7bbd172cca tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:35.412248 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40bfdc59-9fa0-4e74-ae10-da7bbd172cca tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:35.412704 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40bfdc59-9fa0-4e74-ae10-da7bbd172cca tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:35.413402 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40bfdc59-9fa0-4e74-ae10-da7bbd172cca tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:35.413850 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40bfdc59-9fa0-4e74-ae10-da7bbd172cca tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:35.414293 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40bfdc59-9fa0-4e74-ae10-da7bbd172cca tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:35.551164 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-40bfdc59-9fa0-4e74-ae10-da7bbd172cca tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:35.560473 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-40bfdc59-9fa0-4e74-ae10-da7bbd172cca tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2" status: 200 len: 1318 microversion: 2.1 time: 0.159423 Sep 06 21:16:35.561095 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 221/444] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:35 2022] GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:35.626721 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fd787126-8b61-4865-a2d4-f239691b8626 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:35.627690 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fd787126-8b61-4865-a2d4-f239691b8626 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:35.634780 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd787126-8b61-4865-a2d4-f239691b8626 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:35.635338 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd787126-8b61-4865-a2d4-f239691b8626 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:35.635861 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd787126-8b61-4865-a2d4-f239691b8626 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:35.636969 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd787126-8b61-4865-a2d4-f239691b8626 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:35.637463 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd787126-8b61-4865-a2d4-f239691b8626 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:35.638338 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd787126-8b61-4865-a2d4-f239691b8626 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:35.764991 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-60c81c68-67c0-4f97-99bd-a15ed60e4b11 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:35.765566 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-60c81c68-67c0-4f97-99bd-a15ed60e4b11 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:35.773399 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-fd787126-8b61-4865-a2d4-f239691b8626 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7bb424a25489db00059483f558b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf9183eeeef40f7a99a49d0abfeffa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:35.777493 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60c81c68-67c0-4f97-99bd-a15ed60e4b11 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:35.777980 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60c81c68-67c0-4f97-99bd-a15ed60e4b11 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:35.778405 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60c81c68-67c0-4f97-99bd-a15ed60e4b11 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:35.779154 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60c81c68-67c0-4f97-99bd-a15ed60e4b11 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:35.779586 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60c81c68-67c0-4f97-99bd-a15ed60e4b11 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:35.780020 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60c81c68-67c0-4f97-99bd-a15ed60e4b11 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:35.781589 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fd787126-8b61-4865-a2d4-f239691b8626 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af" status: 200 len: 1314 microversion: 2.1 time: 0.159084 Sep 06 21:16:35.784470 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 224/445] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:35 2022] GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:35.928929 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-60c81c68-67c0-4f97-99bd-a15ed60e4b11 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:35.938382 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-60c81c68-67c0-4f97-99bd-a15ed60e4b11 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1521 microversion: 2.1 time: 0.178053 Sep 06 21:16:35.939067 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 222/446] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:35 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:36.585999 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c9aa4033-449b-4bb4-95f8-5b93637941b0 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:36.586801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c9aa4033-449b-4bb4-95f8-5b93637941b0 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:36.595547 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c9aa4033-449b-4bb4-95f8-5b93637941b0 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:36.596097 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c9aa4033-449b-4bb4-95f8-5b93637941b0 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:36.596498 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c9aa4033-449b-4bb4-95f8-5b93637941b0 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:36.597235 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c9aa4033-449b-4bb4-95f8-5b93637941b0 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:36.597685 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c9aa4033-449b-4bb4-95f8-5b93637941b0 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:36.598103 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c9aa4033-449b-4bb4-95f8-5b93637941b0 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:36.732614 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c9aa4033-449b-4bb4-95f8-5b93637941b0 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:36.744176 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c9aa4033-449b-4bb4-95f8-5b93637941b0 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2" status: 200 len: 1318 microversion: 2.1 time: 0.163517 Sep 06 21:16:36.744968 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 225/447] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:36 2022] GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:36.805499 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ec03a20e-d7dd-4f21-a62b-59c6b19ed46d tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:36.806164 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ec03a20e-d7dd-4f21-a62b-59c6b19ed46d tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:36.812807 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec03a20e-d7dd-4f21-a62b-59c6b19ed46d tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:36.813524 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec03a20e-d7dd-4f21-a62b-59c6b19ed46d tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:36.813959 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec03a20e-d7dd-4f21-a62b-59c6b19ed46d tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:36.814661 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec03a20e-d7dd-4f21-a62b-59c6b19ed46d tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:36.815112 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec03a20e-d7dd-4f21-a62b-59c6b19ed46d tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:36.815529 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec03a20e-d7dd-4f21-a62b-59c6b19ed46d tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:36.952164 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ec03a20e-d7dd-4f21-a62b-59c6b19ed46d tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7bb424a25489db00059483f558b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf9183eeeef40f7a99a49d0abfeffa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:36.960549 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ec03a20e-d7dd-4f21-a62b-59c6b19ed46d tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af" status: 200 len: 1314 microversion: 2.1 time: 0.158932 Sep 06 21:16:36.961149 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 223/448] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:36 2022] GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:36.962804 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7e467cf0-6099-4786-afa1-9fd5a5d5429b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:36.963404 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7e467cf0-6099-4786-afa1-9fd5a5d5429b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:36.969820 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e467cf0-6099-4786-afa1-9fd5a5d5429b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:36.970289 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e467cf0-6099-4786-afa1-9fd5a5d5429b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:36.970709 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e467cf0-6099-4786-afa1-9fd5a5d5429b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:36.971398 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e467cf0-6099-4786-afa1-9fd5a5d5429b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:36.971835 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e467cf0-6099-4786-afa1-9fd5a5d5429b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:36.972242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e467cf0-6099-4786-afa1-9fd5a5d5429b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:37.111113 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7e467cf0-6099-4786-afa1-9fd5a5d5429b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:37.120741 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7e467cf0-6099-4786-afa1-9fd5a5d5429b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1521 microversion: 2.1 time: 0.161713 Sep 06 21:16:37.122023 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 226/449] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:36 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:16:37.766772 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5ae9d692-c4ac-4268-b749-4babec5a8102 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:37.767424 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5ae9d692-c4ac-4268-b749-4babec5a8102 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:37.774216 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ae9d692-c4ac-4268-b749-4babec5a8102 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:37.774781 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ae9d692-c4ac-4268-b749-4babec5a8102 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:37.775347 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ae9d692-c4ac-4268-b749-4babec5a8102 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:37.776100 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ae9d692-c4ac-4268-b749-4babec5a8102 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:37.776536 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ae9d692-c4ac-4268-b749-4babec5a8102 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:37.777184 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ae9d692-c4ac-4268-b749-4babec5a8102 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:37.924242 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5ae9d692-c4ac-4268-b749-4babec5a8102 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:37.932147 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5ae9d692-c4ac-4268-b749-4babec5a8102 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2" status: 200 len: 1318 microversion: 2.1 time: 0.169276 Sep 06 21:16:37.932666 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 224/450] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:37 2022] GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:37.986172 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c5765f83-5f2e-4907-8603-5c2c7bb8e500 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:37.986837 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c5765f83-5f2e-4907-8603-5c2c7bb8e500 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:37.996196 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c5765f83-5f2e-4907-8603-5c2c7bb8e500 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:37.996703 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c5765f83-5f2e-4907-8603-5c2c7bb8e500 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:37.997315 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c5765f83-5f2e-4907-8603-5c2c7bb8e500 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:37.998382 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c5765f83-5f2e-4907-8603-5c2c7bb8e500 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:37.999017 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c5765f83-5f2e-4907-8603-5c2c7bb8e500 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:37.999603 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c5765f83-5f2e-4907-8603-5c2c7bb8e500 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:38.145746 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c5765f83-5f2e-4907-8603-5c2c7bb8e500 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7bb424a25489db00059483f558b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf9183eeeef40f7a99a49d0abfeffa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:38.153050 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-60f606ba-62eb-494a-b232-96e352b8c16c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:38.153652 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-60f606ba-62eb-494a-b232-96e352b8c16c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:38.153806 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c5765f83-5f2e-4907-8603-5c2c7bb8e500 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af" status: 200 len: 1314 microversion: 2.1 time: 0.173619 Sep 06 21:16:38.154237 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 227/451] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:37 2022] GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:38.159802 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60f606ba-62eb-494a-b232-96e352b8c16c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:38.160280 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60f606ba-62eb-494a-b232-96e352b8c16c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:38.160727 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60f606ba-62eb-494a-b232-96e352b8c16c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:38.161422 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60f606ba-62eb-494a-b232-96e352b8c16c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:38.161865 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60f606ba-62eb-494a-b232-96e352b8c16c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:38.162279 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60f606ba-62eb-494a-b232-96e352b8c16c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:38.298357 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-60f606ba-62eb-494a-b232-96e352b8c16c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:38.306737 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-60f606ba-62eb-494a-b232-96e352b8c16c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1521 microversion: 2.1 time: 0.157634 Sep 06 21:16:38.307318 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 225/452] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:38 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:38.915264 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-571b096e-f1a8-46ac-8dc7-e546648c952c req-f3acbedd-b38d-4168-8224-8ba098a27b37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8213fe3f-e8c0-4919-b1d8-02f6c049b0d2", "name": "network-vif-plugged", "status": "completed", "tag": "1795cb49-18af-42b5-8214-76d1f8210b66"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:16:38.927276 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-571b096e-f1a8-46ac-8dc7-e546648c952c req-f3acbedd-b38d-4168-8224-8ba098a27b37 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:38.928311 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-571b096e-f1a8-46ac-8dc7-e546648c952c req-f3acbedd-b38d-4168-8224-8ba098a27b37 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:38.928768 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-571b096e-f1a8-46ac-8dc7-e546648c952c req-f3acbedd-b38d-4168-8224-8ba098a27b37 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:38.941085 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-571b096e-f1a8-46ac-8dc7-e546648c952c req-f3acbedd-b38d-4168-8224-8ba098a27b37 service nova] Creating event network-vif-plugged:1795cb49-18af-42b5-8214-76d1f8210b66 for instance 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 on hv-cinder-74915 Sep 06 21:16:38.946538 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-571b096e-f1a8-46ac-8dc7-e546648c952c req-f3acbedd-b38d-4168-8224-8ba098a27b37 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036209 Sep 06 21:16:38.947096 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 228/453] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 21:16:38.955433 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bdaf790c-cca5-44f0-822e-a706613c532f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:38.956041 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bdaf790c-cca5-44f0-822e-a706613c532f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:38.963361 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bdaf790c-cca5-44f0-822e-a706613c532f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:38.965079 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bdaf790c-cca5-44f0-822e-a706613c532f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:38.965688 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bdaf790c-cca5-44f0-822e-a706613c532f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:38.966550 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bdaf790c-cca5-44f0-822e-a706613c532f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:38.967148 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bdaf790c-cca5-44f0-822e-a706613c532f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:38.967736 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bdaf790c-cca5-44f0-822e-a706613c532f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:39.097484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bdaf790c-cca5-44f0-822e-a706613c532f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:39.108315 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bdaf790c-cca5-44f0-822e-a706613c532f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2" status: 200 len: 1318 microversion: 2.1 time: 0.156795 Sep 06 21:16:39.109067 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 226/454] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:38 2022] GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:39.179040 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dbf42b8b-6c2c-4963-bf67-ed750e210ae5 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:39.179902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dbf42b8b-6c2c-4963-bf67-ed750e210ae5 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:39.187079 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dbf42b8b-6c2c-4963-bf67-ed750e210ae5 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:39.187554 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dbf42b8b-6c2c-4963-bf67-ed750e210ae5 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:39.187985 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dbf42b8b-6c2c-4963-bf67-ed750e210ae5 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:39.188700 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dbf42b8b-6c2c-4963-bf67-ed750e210ae5 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:39.189167 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dbf42b8b-6c2c-4963-bf67-ed750e210ae5 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:39.189587 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dbf42b8b-6c2c-4963-bf67-ed750e210ae5 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:39.330512 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dc7c375f-bb67-42b6-86ae-0fbfb16cb3e5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:39.331191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dc7c375f-bb67-42b6-86ae-0fbfb16cb3e5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:39.331596 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-dbf42b8b-6c2c-4963-bf67-ed750e210ae5 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7bb424a25489db00059483f558b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf9183eeeef40f7a99a49d0abfeffa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:39.337435 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dc7c375f-bb67-42b6-86ae-0fbfb16cb3e5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:39.337879 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dc7c375f-bb67-42b6-86ae-0fbfb16cb3e5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:39.338499 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dc7c375f-bb67-42b6-86ae-0fbfb16cb3e5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:39.339198 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dc7c375f-bb67-42b6-86ae-0fbfb16cb3e5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:39.339872 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dc7c375f-bb67-42b6-86ae-0fbfb16cb3e5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:39.340351 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dc7c375f-bb67-42b6-86ae-0fbfb16cb3e5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:39.340487 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dbf42b8b-6c2c-4963-bf67-ed750e210ae5 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af" status: 200 len: 1464 microversion: 2.1 time: 0.166515 Sep 06 21:16:39.340770 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 229/455] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:39 2022] GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af => generated 1464 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:39.394785 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9ee81af0-2daa-4b23-abcc-6cd6429245b5 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:39.395379 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9ee81af0-2daa-4b23-abcc-6cd6429245b5 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:39.401678 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ee81af0-2daa-4b23-abcc-6cd6429245b5 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:39.402161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ee81af0-2daa-4b23-abcc-6cd6429245b5 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:39.402595 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ee81af0-2daa-4b23-abcc-6cd6429245b5 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:39.403300 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ee81af0-2daa-4b23-abcc-6cd6429245b5 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:39.403849 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ee81af0-2daa-4b23-abcc-6cd6429245b5 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:39.404173 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ee81af0-2daa-4b23-abcc-6cd6429245b5 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:39.430744 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9ee81af0-2daa-4b23-abcc-6cd6429245b5 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 21:16:39.481687 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-dc7c375f-bb67-42b6-86ae-0fbfb16cb3e5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:39.490747 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dc7c375f-bb67-42b6-86ae-0fbfb16cb3e5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1521 microversion: 2.1 time: 0.164733 Sep 06 21:16:39.491325 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 227/456] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:39 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:16:39.538020 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9ee81af0-2daa-4b23-abcc-6cd6429245b5 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "DELETE /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af" status: 204 len: 0 microversion: 2.1 time: 0.147756 Sep 06 21:16:39.538833 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 230/457] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Sep 6 21:16:39 2022] DELETE /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 21:16:39.547190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-46ed3abc-e12f-47fd-9092-a9ccc9306ca9 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:39.548061 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-46ed3abc-e12f-47fd-9092-a9ccc9306ca9 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:39.554872 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46ed3abc-e12f-47fd-9092-a9ccc9306ca9 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:39.555353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46ed3abc-e12f-47fd-9092-a9ccc9306ca9 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:39.555773 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46ed3abc-e12f-47fd-9092-a9ccc9306ca9 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:39.556466 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46ed3abc-e12f-47fd-9092-a9ccc9306ca9 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:39.557331 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46ed3abc-e12f-47fd-9092-a9ccc9306ca9 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:39.557773 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46ed3abc-e12f-47fd-9092-a9ccc9306ca9 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:39.689703 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-46ed3abc-e12f-47fd-9092-a9ccc9306ca9 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7bb424a25489db00059483f558b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf9183eeeef40f7a99a49d0abfeffa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:39.698361 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-46ed3abc-e12f-47fd-9092-a9ccc9306ca9 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af" status: 200 len: 1470 microversion: 2.1 time: 0.155143 Sep 06 21:16:39.698923 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 228/458] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:39 2022] GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:40.132163 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a88fa811-79cc-4216-a33c-224a9d172dfa tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:40.132896 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a88fa811-79cc-4216-a33c-224a9d172dfa tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:40.139340 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a88fa811-79cc-4216-a33c-224a9d172dfa tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:40.139815 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a88fa811-79cc-4216-a33c-224a9d172dfa tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:40.140245 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a88fa811-79cc-4216-a33c-224a9d172dfa tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:40.140970 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a88fa811-79cc-4216-a33c-224a9d172dfa tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:40.141389 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a88fa811-79cc-4216-a33c-224a9d172dfa tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:40.141809 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a88fa811-79cc-4216-a33c-224a9d172dfa tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:40.285323 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a88fa811-79cc-4216-a33c-224a9d172dfa tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:40.293987 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a88fa811-79cc-4216-a33c-224a9d172dfa tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2" status: 200 len: 1318 microversion: 2.1 time: 0.165621 Sep 06 21:16:40.294348 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 231/459] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:40 2022] GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:40.513874 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0f2dd4e8-f4bd-4300-8be7-ce5ec8090dc5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:40.514448 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0f2dd4e8-f4bd-4300-8be7-ce5ec8090dc5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:40.520520 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f2dd4e8-f4bd-4300-8be7-ce5ec8090dc5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:40.521029 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f2dd4e8-f4bd-4300-8be7-ce5ec8090dc5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:40.521450 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f2dd4e8-f4bd-4300-8be7-ce5ec8090dc5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:40.522124 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f2dd4e8-f4bd-4300-8be7-ce5ec8090dc5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:40.522560 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f2dd4e8-f4bd-4300-8be7-ce5ec8090dc5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:40.522946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f2dd4e8-f4bd-4300-8be7-ce5ec8090dc5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:40.661799 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0f2dd4e8-f4bd-4300-8be7-ce5ec8090dc5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:40.669802 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0f2dd4e8-f4bd-4300-8be7-ce5ec8090dc5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1521 microversion: 2.1 time: 0.159869 Sep 06 21:16:40.670371 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 229/460] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:40 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:40.721743 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dc868976-18f8-45e1-92f8-825edac056af tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:40.722382 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dc868976-18f8-45e1-92f8-825edac056af tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:40.728967 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc868976-18f8-45e1-92f8-825edac056af tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:40.729456 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc868976-18f8-45e1-92f8-825edac056af tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:40.729885 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc868976-18f8-45e1-92f8-825edac056af tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:40.730582 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc868976-18f8-45e1-92f8-825edac056af tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:40.731034 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc868976-18f8-45e1-92f8-825edac056af tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:40.731456 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc868976-18f8-45e1-92f8-825edac056af tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:40.869713 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-dc868976-18f8-45e1-92f8-825edac056af tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7bb424a25489db00059483f558b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf9183eeeef40f7a99a49d0abfeffa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:40.877852 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dc868976-18f8-45e1-92f8-825edac056af tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af" status: 200 len: 1470 microversion: 2.1 time: 0.160074 Sep 06 21:16:40.878414 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 232/461] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:40 2022] GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:41.322319 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e887ce87-1a70-4d26-933b-7bd5f6ca05e4 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:41.322865 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e887ce87-1a70-4d26-933b-7bd5f6ca05e4 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:41.329308 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e887ce87-1a70-4d26-933b-7bd5f6ca05e4 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:41.329848 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e887ce87-1a70-4d26-933b-7bd5f6ca05e4 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:41.330271 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e887ce87-1a70-4d26-933b-7bd5f6ca05e4 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:41.330970 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e887ce87-1a70-4d26-933b-7bd5f6ca05e4 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:41.331411 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e887ce87-1a70-4d26-933b-7bd5f6ca05e4 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:41.331827 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e887ce87-1a70-4d26-933b-7bd5f6ca05e4 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:41.486304 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e887ce87-1a70-4d26-933b-7bd5f6ca05e4 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:41.494365 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e887ce87-1a70-4d26-933b-7bd5f6ca05e4 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2" status: 200 len: 1318 microversion: 2.1 time: 0.176092 Sep 06 21:16:41.494934 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 230/462] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:41 2022] GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:41.701928 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2baa1dc2-53bd-4007-bb0b-1a5d931026a3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:41.702532 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2baa1dc2-53bd-4007-bb0b-1a5d931026a3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:41.710002 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2baa1dc2-53bd-4007-bb0b-1a5d931026a3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:41.710630 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2baa1dc2-53bd-4007-bb0b-1a5d931026a3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:41.711226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2baa1dc2-53bd-4007-bb0b-1a5d931026a3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:41.711937 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2baa1dc2-53bd-4007-bb0b-1a5d931026a3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:41.712384 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2baa1dc2-53bd-4007-bb0b-1a5d931026a3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:41.712846 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2baa1dc2-53bd-4007-bb0b-1a5d931026a3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:41.846280 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2baa1dc2-53bd-4007-bb0b-1a5d931026a3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:41.854519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2baa1dc2-53bd-4007-bb0b-1a5d931026a3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1521 microversion: 2.1 time: 0.156615 Sep 06 21:16:41.855097 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 233/463] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:41 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:41.901827 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e183e603-8714-4a7b-998e-13fd0da6f590 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:41.902479 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e183e603-8714-4a7b-998e-13fd0da6f590 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:41.909008 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e183e603-8714-4a7b-998e-13fd0da6f590 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:41.909525 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e183e603-8714-4a7b-998e-13fd0da6f590 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:41.910019 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e183e603-8714-4a7b-998e-13fd0da6f590 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:41.910777 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e183e603-8714-4a7b-998e-13fd0da6f590 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:41.911245 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e183e603-8714-4a7b-998e-13fd0da6f590 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:41.911706 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e183e603-8714-4a7b-998e-13fd0da6f590 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:42.050668 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e183e603-8714-4a7b-998e-13fd0da6f590 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7bb424a25489db00059483f558b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf9183eeeef40f7a99a49d0abfeffa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:42.058808 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e183e603-8714-4a7b-998e-13fd0da6f590 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af" status: 200 len: 1470 microversion: 2.1 time: 0.161169 Sep 06 21:16:42.059368 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 231/464] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:41 2022] GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:42.518529 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0cbaf3ab-fb55-42ec-9102-ba3302365557 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:42.519215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0cbaf3ab-fb55-42ec-9102-ba3302365557 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:42.527073 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0cbaf3ab-fb55-42ec-9102-ba3302365557 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:42.527900 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0cbaf3ab-fb55-42ec-9102-ba3302365557 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:42.528411 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0cbaf3ab-fb55-42ec-9102-ba3302365557 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:42.529157 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0cbaf3ab-fb55-42ec-9102-ba3302365557 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:42.529712 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0cbaf3ab-fb55-42ec-9102-ba3302365557 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:42.530206 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0cbaf3ab-fb55-42ec-9102-ba3302365557 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:42.678547 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0cbaf3ab-fb55-42ec-9102-ba3302365557 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:42.688592 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0cbaf3ab-fb55-42ec-9102-ba3302365557 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2" status: 200 len: 1318 microversion: 2.1 time: 0.174977 Sep 06 21:16:42.689850 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 234/465] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:42 2022] GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:42.880486 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5d522c7d-b58e-4edc-9aed-5bf0fec18dd9 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:42.881413 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5d522c7d-b58e-4edc-9aed-5bf0fec18dd9 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:42.889998 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d522c7d-b58e-4edc-9aed-5bf0fec18dd9 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:42.890511 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d522c7d-b58e-4edc-9aed-5bf0fec18dd9 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:42.890937 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d522c7d-b58e-4edc-9aed-5bf0fec18dd9 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:42.891637 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d522c7d-b58e-4edc-9aed-5bf0fec18dd9 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:42.892119 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d522c7d-b58e-4edc-9aed-5bf0fec18dd9 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:42.892535 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d522c7d-b58e-4edc-9aed-5bf0fec18dd9 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:43.086434 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5f33953f-249b-4116-96ef-25c86c4f7e4d tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:43.087614 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5f33953f-249b-4116-96ef-25c86c4f7e4d tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:43.099683 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f33953f-249b-4116-96ef-25c86c4f7e4d tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:43.100319 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f33953f-249b-4116-96ef-25c86c4f7e4d tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:43.101107 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f33953f-249b-4116-96ef-25c86c4f7e4d tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:43.102220 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f33953f-249b-4116-96ef-25c86c4f7e4d tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:43.102928 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f33953f-249b-4116-96ef-25c86c4f7e4d tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:43.103612 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f33953f-249b-4116-96ef-25c86c4f7e4d tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:43.122383 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5d522c7d-b58e-4edc-9aed-5bf0fec18dd9 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:43.134089 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5d522c7d-b58e-4edc-9aed-5bf0fec18dd9 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1521 microversion: 2.1 time: 0.259529 Sep 06 21:16:43.135687 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 232/466] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:42 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:43.256213 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5f33953f-249b-4116-96ef-25c86c4f7e4d tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7bb424a25489db00059483f558b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf9183eeeef40f7a99a49d0abfeffa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:43.264527 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5f33953f-249b-4116-96ef-25c86c4f7e4d tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af" status: 200 len: 1470 microversion: 2.1 time: 0.185376 Sep 06 21:16:43.265132 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 235/467] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:43 2022] GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af => generated 1470 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:16:43.293685 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a6661d12-bc31-408a-96a1-b68e24cff90d req-c7e7fd97-70ad-4e74-b72b-3018819b5c91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feb89148-4abf-4f2e-aa7b-422bfa0111af", "name": "network-vif-deleted", "tag": "cf251011-5971-41a7-ac49-c0dd74d4dbf6"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:16:43.304958 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a6661d12-bc31-408a-96a1-b68e24cff90d req-c7e7fd97-70ad-4e74-b72b-3018819b5c91 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:43.305594 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a6661d12-bc31-408a-96a1-b68e24cff90d req-c7e7fd97-70ad-4e74-b72b-3018819b5c91 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:43.306153 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a6661d12-bc31-408a-96a1-b68e24cff90d req-c7e7fd97-70ad-4e74-b72b-3018819b5c91 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:43.322097 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a6661d12-bc31-408a-96a1-b68e24cff90d req-c7e7fd97-70ad-4e74-b72b-3018819b5c91 service nova] Creating event network-vif-deleted:cf251011-5971-41a7-ac49-c0dd74d4dbf6 for instance feb89148-4abf-4f2e-aa7b-422bfa0111af on hv-cinder-74915 Sep 06 21:16:43.327724 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a6661d12-bc31-408a-96a1-b68e24cff90d req-c7e7fd97-70ad-4e74-b72b-3018819b5c91 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037905 Sep 06 21:16:43.328592 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 233/468] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:16:43.713204 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cc671526-ae5d-4746-8595-1eab99d5d10d tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:43.713981 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cc671526-ae5d-4746-8595-1eab99d5d10d tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:43.720358 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc671526-ae5d-4746-8595-1eab99d5d10d tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:43.721531 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc671526-ae5d-4746-8595-1eab99d5d10d tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:43.721531 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc671526-ae5d-4746-8595-1eab99d5d10d tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:43.721997 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc671526-ae5d-4746-8595-1eab99d5d10d tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:43.722444 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc671526-ae5d-4746-8595-1eab99d5d10d tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:43.722867 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc671526-ae5d-4746-8595-1eab99d5d10d tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:43.887302 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-cc671526-ae5d-4746-8595-1eab99d5d10d tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:43.898158 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cc671526-ae5d-4746-8595-1eab99d5d10d tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2" status: 200 len: 1318 microversion: 2.1 time: 0.189683 Sep 06 21:16:43.898835 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 236/469] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:43 2022] GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:44.162462 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9aed2c28-17d9-41f8-9a19-97ef58f2beb9 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:44.163158 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9aed2c28-17d9-41f8-9a19-97ef58f2beb9 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:44.170752 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9aed2c28-17d9-41f8-9a19-97ef58f2beb9 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:44.171462 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9aed2c28-17d9-41f8-9a19-97ef58f2beb9 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:44.171882 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9aed2c28-17d9-41f8-9a19-97ef58f2beb9 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:44.172900 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9aed2c28-17d9-41f8-9a19-97ef58f2beb9 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:44.173524 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9aed2c28-17d9-41f8-9a19-97ef58f2beb9 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:44.174283 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9aed2c28-17d9-41f8-9a19-97ef58f2beb9 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:44.297027 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-59781491-4ab3-4173-aaaf-12720390517c tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:44.297838 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-59781491-4ab3-4173-aaaf-12720390517c tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:44.328550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59781491-4ab3-4173-aaaf-12720390517c tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:44.330382 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59781491-4ab3-4173-aaaf-12720390517c tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:44.330382 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59781491-4ab3-4173-aaaf-12720390517c tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:44.331341 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59781491-4ab3-4173-aaaf-12720390517c tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:44.331341 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59781491-4ab3-4173-aaaf-12720390517c tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:44.331925 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59781491-4ab3-4173-aaaf-12720390517c tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:44.375243 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59781491-4ab3-4173-aaaf-12720390517c tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:44.375668 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59781491-4ab3-4173-aaaf-12720390517c tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:44.376391 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59781491-4ab3-4173-aaaf-12720390517c tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:44.376898 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-59781491-4ab3-4173-aaaf-12720390517c tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lazy-loading 'fault' on Instance uuid feb89148-4abf-4f2e-aa7b-422bfa0111af {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:16:44.403934 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9aed2c28-17d9-41f8-9a19-97ef58f2beb9 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:44.413607 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9aed2c28-17d9-41f8-9a19-97ef58f2beb9 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1521 microversion: 2.1 time: 0.255794 Sep 06 21:16:44.414324 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 234/470] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:44 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:44.431099 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-59781491-4ab3-4173-aaaf-12720390517c tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7bb424a25489db00059483f558b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf9183eeeef40f7a99a49d0abfeffa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:44.435772 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:44.445382 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-59781491-4ab3-4173-aaaf-12720390517c tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af" status: 200 len: 1304 microversion: 2.1 time: 0.158122 Sep 06 21:16:44.445964 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 237/471] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:44 2022] GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af => generated 1304 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:44.925536 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c72a772e-710f-44f9-bb4c-8c3bcbda6d13 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:44.926388 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c72a772e-710f-44f9-bb4c-8c3bcbda6d13 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:44.932763 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c72a772e-710f-44f9-bb4c-8c3bcbda6d13 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:44.933420 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c72a772e-710f-44f9-bb4c-8c3bcbda6d13 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:44.933851 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c72a772e-710f-44f9-bb4c-8c3bcbda6d13 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:44.934553 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c72a772e-710f-44f9-bb4c-8c3bcbda6d13 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:44.935164 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c72a772e-710f-44f9-bb4c-8c3bcbda6d13 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:44.935752 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c72a772e-710f-44f9-bb4c-8c3bcbda6d13 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:45.071940 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c72a772e-710f-44f9-bb4c-8c3bcbda6d13 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:45.080324 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c72a772e-710f-44f9-bb4c-8c3bcbda6d13 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2" status: 200 len: 1507 microversion: 2.1 time: 0.158828 Sep 06 21:16:45.081060 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 235/472] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:44 2022] GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:45.444287 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5eaf3089-3cf9-4435-a02f-64db7ec2c87e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:45.445077 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5eaf3089-3cf9-4435-a02f-64db7ec2c87e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:45.456187 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5eaf3089-3cf9-4435-a02f-64db7ec2c87e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:45.457477 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5eaf3089-3cf9-4435-a02f-64db7ec2c87e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:45.458009 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5eaf3089-3cf9-4435-a02f-64db7ec2c87e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:45.458981 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5eaf3089-3cf9-4435-a02f-64db7ec2c87e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:45.459689 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5eaf3089-3cf9-4435-a02f-64db7ec2c87e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:45.460271 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5eaf3089-3cf9-4435-a02f-64db7ec2c87e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:45.473869 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-38fcd79c-46df-4348-afb9-b624ac375eda tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:45.475640 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-38fcd79c-46df-4348-afb9-b624ac375eda tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:45.484267 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38fcd79c-46df-4348-afb9-b624ac375eda tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:45.485077 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38fcd79c-46df-4348-afb9-b624ac375eda tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:45.486027 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38fcd79c-46df-4348-afb9-b624ac375eda tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:45.487332 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38fcd79c-46df-4348-afb9-b624ac375eda tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:45.488377 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38fcd79c-46df-4348-afb9-b624ac375eda tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:45.489495 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38fcd79c-46df-4348-afb9-b624ac375eda tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:45.531695 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38fcd79c-46df-4348-afb9-b624ac375eda tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:45.532706 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38fcd79c-46df-4348-afb9-b624ac375eda tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:45.533425 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38fcd79c-46df-4348-afb9-b624ac375eda tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:45.534197 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-38fcd79c-46df-4348-afb9-b624ac375eda tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lazy-loading 'fault' on Instance uuid feb89148-4abf-4f2e-aa7b-422bfa0111af {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:16:45.650977 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-38fcd79c-46df-4348-afb9-b624ac375eda tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7bb424a25489db00059483f558b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf9183eeeef40f7a99a49d0abfeffa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:45.659466 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:45.664690 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-38fcd79c-46df-4348-afb9-b624ac375eda tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af" status: 200 len: 1304 microversion: 2.1 time: 0.196511 Sep 06 21:16:45.675691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 236/473] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:45 2022] GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af => generated 1304 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:45.702361 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5eaf3089-3cf9-4435-a02f-64db7ec2c87e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:45.711255 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5eaf3089-3cf9-4435-a02f-64db7ec2c87e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1521 microversion: 2.1 time: 0.275271 Sep 06 21:16:45.711934 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 238/474] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:45 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:46.690848 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-886ad54d-751e-4a33-85c1-96b410f15104 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:46.690848 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-886ad54d-751e-4a33-85c1-96b410f15104 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:46.701980 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-886ad54d-751e-4a33-85c1-96b410f15104 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:46.702465 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-886ad54d-751e-4a33-85c1-96b410f15104 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:46.702952 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-886ad54d-751e-4a33-85c1-96b410f15104 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:46.703981 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-886ad54d-751e-4a33-85c1-96b410f15104 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:46.704414 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-886ad54d-751e-4a33-85c1-96b410f15104 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:46.705169 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-886ad54d-751e-4a33-85c1-96b410f15104 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:46.735139 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d93dbf45-40fa-4cc0-b48e-4c93e954f540 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:46.736046 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d93dbf45-40fa-4cc0-b48e-4c93e954f540 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:46.739253 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-886ad54d-751e-4a33-85c1-96b410f15104 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:46.739730 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-886ad54d-751e-4a33-85c1-96b410f15104 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:46.740152 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-886ad54d-751e-4a33-85c1-96b410f15104 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:46.740593 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-886ad54d-751e-4a33-85c1-96b410f15104 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lazy-loading 'fault' on Instance uuid feb89148-4abf-4f2e-aa7b-422bfa0111af {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:16:46.743832 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d93dbf45-40fa-4cc0-b48e-4c93e954f540 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:46.744329 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d93dbf45-40fa-4cc0-b48e-4c93e954f540 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:46.744796 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d93dbf45-40fa-4cc0-b48e-4c93e954f540 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:46.745495 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d93dbf45-40fa-4cc0-b48e-4c93e954f540 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:46.745943 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d93dbf45-40fa-4cc0-b48e-4c93e954f540 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:46.746351 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d93dbf45-40fa-4cc0-b48e-4c93e954f540 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:46.785970 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-886ad54d-751e-4a33-85c1-96b410f15104 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7bb424a25489db00059483f558b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf9183eeeef40f7a99a49d0abfeffa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:46.794717 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-886ad54d-751e-4a33-85c1-96b410f15104 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af" status: 200 len: 1304 microversion: 2.1 time: 0.108534 Sep 06 21:16:46.795303 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 237/475] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:46 2022] GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:46.885022 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d93dbf45-40fa-4cc0-b48e-4c93e954f540 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:46.893161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d93dbf45-40fa-4cc0-b48e-4c93e954f540 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1521 microversion: 2.1 time: 0.161914 Sep 06 21:16:46.893730 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 239/476] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:46 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:16:47.820365 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1657a0ab-8fbd-4747-8eca-a0332cffa875 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:47.821212 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1657a0ab-8fbd-4747-8eca-a0332cffa875 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:47.828257 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1657a0ab-8fbd-4747-8eca-a0332cffa875 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:47.828837 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1657a0ab-8fbd-4747-8eca-a0332cffa875 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:47.829309 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1657a0ab-8fbd-4747-8eca-a0332cffa875 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:47.830055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1657a0ab-8fbd-4747-8eca-a0332cffa875 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:47.830550 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1657a0ab-8fbd-4747-8eca-a0332cffa875 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:47.831032 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1657a0ab-8fbd-4747-8eca-a0332cffa875 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:47.862467 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1657a0ab-8fbd-4747-8eca-a0332cffa875 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:47.862962 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1657a0ab-8fbd-4747-8eca-a0332cffa875 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:47.863375 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1657a0ab-8fbd-4747-8eca-a0332cffa875 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:47.863803 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-1657a0ab-8fbd-4747-8eca-a0332cffa875 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lazy-loading 'fault' on Instance uuid feb89148-4abf-4f2e-aa7b-422bfa0111af {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:16:47.914535 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1657a0ab-8fbd-4747-8eca-a0332cffa875 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7bb424a25489db00059483f558b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf9183eeeef40f7a99a49d0abfeffa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:47.917822 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9ca30e5d-4d90-4d84-b2e6-7372d73de08c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:47.918493 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9ca30e5d-4d90-4d84-b2e6-7372d73de08c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:47.923221 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1657a0ab-8fbd-4747-8eca-a0332cffa875 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af" status: 200 len: 1304 microversion: 2.1 time: 0.107557 Sep 06 21:16:47.924217 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 238/477] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:47 2022] GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:47.925925 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ca30e5d-4d90-4d84-b2e6-7372d73de08c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:47.926446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ca30e5d-4d90-4d84-b2e6-7372d73de08c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:47.927028 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ca30e5d-4d90-4d84-b2e6-7372d73de08c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:47.927746 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ca30e5d-4d90-4d84-b2e6-7372d73de08c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:47.928276 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ca30e5d-4d90-4d84-b2e6-7372d73de08c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:47.928808 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ca30e5d-4d90-4d84-b2e6-7372d73de08c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:48.070705 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9ca30e5d-4d90-4d84-b2e6-7372d73de08c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:48.078833 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9ca30e5d-4d90-4d84-b2e6-7372d73de08c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1521 microversion: 2.1 time: 0.165027 Sep 06 21:16:48.079404 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 240/478] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:47 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:48.950502 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d3a1b7f5-3df1-45d3-bbc5-73c272de11cb tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:48.951112 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d3a1b7f5-3df1-45d3-bbc5-73c272de11cb tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:48.957465 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3a1b7f5-3df1-45d3-bbc5-73c272de11cb tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:48.958116 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3a1b7f5-3df1-45d3-bbc5-73c272de11cb tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:48.958829 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3a1b7f5-3df1-45d3-bbc5-73c272de11cb tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:48.959282 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3a1b7f5-3df1-45d3-bbc5-73c272de11cb tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:48.959731 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3a1b7f5-3df1-45d3-bbc5-73c272de11cb tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:48.960152 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3a1b7f5-3df1-45d3-bbc5-73c272de11cb tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:48.989205 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:48.994573 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3a1b7f5-3df1-45d3-bbc5-73c272de11cb tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:48.995041 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3a1b7f5-3df1-45d3-bbc5-73c272de11cb tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:48.995547 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3a1b7f5-3df1-45d3-bbc5-73c272de11cb tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:48.996028 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-d3a1b7f5-3df1-45d3-bbc5-73c272de11cb tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lazy-loading 'fault' on Instance uuid feb89148-4abf-4f2e-aa7b-422bfa0111af {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:16:49.038494 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d3a1b7f5-3df1-45d3-bbc5-73c272de11cb tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7bb424a25489db00059483f558b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf9183eeeef40f7a99a49d0abfeffa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:49.046396 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d3a1b7f5-3df1-45d3-bbc5-73c272de11cb tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af" status: 200 len: 1304 microversion: 2.1 time: 0.099791 Sep 06 21:16:49.046967 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 239/479] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:48 2022] GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:49.102421 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-be592819-dda5-4e0d-99ee-3f387ded60e0 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:49.103058 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-be592819-dda5-4e0d-99ee-3f387ded60e0 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:49.109934 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be592819-dda5-4e0d-99ee-3f387ded60e0 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:49.110418 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be592819-dda5-4e0d-99ee-3f387ded60e0 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:49.110857 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be592819-dda5-4e0d-99ee-3f387ded60e0 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:49.111557 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be592819-dda5-4e0d-99ee-3f387ded60e0 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:49.112010 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be592819-dda5-4e0d-99ee-3f387ded60e0 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:49.112434 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be592819-dda5-4e0d-99ee-3f387ded60e0 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:49.258933 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-be592819-dda5-4e0d-99ee-3f387ded60e0 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:49.267569 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-be592819-dda5-4e0d-99ee-3f387ded60e0 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1521 microversion: 2.1 time: 0.169012 Sep 06 21:16:49.268152 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 241/480] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:49 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:50.070055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-996895f6-44de-4016-82a4-015f45e5ff5e tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:50.071720 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-996895f6-44de-4016-82a4-015f45e5ff5e tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:50.079067 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-996895f6-44de-4016-82a4-015f45e5ff5e tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:50.079718 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-996895f6-44de-4016-82a4-015f45e5ff5e tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:50.080278 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-996895f6-44de-4016-82a4-015f45e5ff5e tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:50.081403 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-996895f6-44de-4016-82a4-015f45e5ff5e tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:50.081990 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-996895f6-44de-4016-82a4-015f45e5ff5e tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:50.082410 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-996895f6-44de-4016-82a4-015f45e5ff5e tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:50.113726 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-996895f6-44de-4016-82a4-015f45e5ff5e tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:50.114194 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-996895f6-44de-4016-82a4-015f45e5ff5e tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:50.114613 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-996895f6-44de-4016-82a4-015f45e5ff5e tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:50.115044 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-996895f6-44de-4016-82a4-015f45e5ff5e tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lazy-loading 'fault' on Instance uuid feb89148-4abf-4f2e-aa7b-422bfa0111af {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:16:50.167565 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-996895f6-44de-4016-82a4-015f45e5ff5e tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7bb424a25489db00059483f558b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf9183eeeef40f7a99a49d0abfeffa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:50.175875 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-996895f6-44de-4016-82a4-015f45e5ff5e tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af" status: 200 len: 1304 microversion: 2.1 time: 0.110021 Sep 06 21:16:50.176425 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 240/481] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:50 2022] GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:50.297067 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3811f93c-b061-4f5b-a83c-8db08ee689e8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:50.297683 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3811f93c-b061-4f5b-a83c-8db08ee689e8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:50.300908 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:50.304383 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3811f93c-b061-4f5b-a83c-8db08ee689e8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:50.304942 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3811f93c-b061-4f5b-a83c-8db08ee689e8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:50.305364 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3811f93c-b061-4f5b-a83c-8db08ee689e8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:50.306034 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3811f93c-b061-4f5b-a83c-8db08ee689e8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:50.306483 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3811f93c-b061-4f5b-a83c-8db08ee689e8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:50.306918 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3811f93c-b061-4f5b-a83c-8db08ee689e8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:50.442343 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3811f93c-b061-4f5b-a83c-8db08ee689e8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:50.456106 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3811f93c-b061-4f5b-a83c-8db08ee689e8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1521 microversion: 2.1 time: 0.163251 Sep 06 21:16:50.457113 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 242/482] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:50 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:51.206283 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-50ff1ca4-c9e0-4ff2-ad0e-2099d44460cc tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:51.207154 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-50ff1ca4-c9e0-4ff2-ad0e-2099d44460cc tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:51.213986 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50ff1ca4-c9e0-4ff2-ad0e-2099d44460cc tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:51.214463 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50ff1ca4-c9e0-4ff2-ad0e-2099d44460cc tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:51.214906 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50ff1ca4-c9e0-4ff2-ad0e-2099d44460cc tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:51.215632 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50ff1ca4-c9e0-4ff2-ad0e-2099d44460cc tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:51.216090 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50ff1ca4-c9e0-4ff2-ad0e-2099d44460cc tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:51.216481 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50ff1ca4-c9e0-4ff2-ad0e-2099d44460cc tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:51.250066 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50ff1ca4-c9e0-4ff2-ad0e-2099d44460cc tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:51.250535 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50ff1ca4-c9e0-4ff2-ad0e-2099d44460cc tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:51.250954 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50ff1ca4-c9e0-4ff2-ad0e-2099d44460cc tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:51.251389 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-50ff1ca4-c9e0-4ff2-ad0e-2099d44460cc tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lazy-loading 'fault' on Instance uuid feb89148-4abf-4f2e-aa7b-422bfa0111af {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:16:51.294018 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-50ff1ca4-c9e0-4ff2-ad0e-2099d44460cc tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7bb424a25489db00059483f558b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf9183eeeef40f7a99a49d0abfeffa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:51.303313 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-50ff1ca4-c9e0-4ff2-ad0e-2099d44460cc tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af" status: 200 len: 1304 microversion: 2.1 time: 0.106792 Sep 06 21:16:51.303901 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 241/483] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:51 2022] GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:51.482242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2e18939f-1d31-4c7a-b591-ac79bcc76674 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:51.483162 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2e18939f-1d31-4c7a-b591-ac79bcc76674 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:51.490334 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e18939f-1d31-4c7a-b591-ac79bcc76674 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:51.490818 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e18939f-1d31-4c7a-b591-ac79bcc76674 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:51.491249 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e18939f-1d31-4c7a-b591-ac79bcc76674 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:51.491955 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e18939f-1d31-4c7a-b591-ac79bcc76674 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:51.492398 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e18939f-1d31-4c7a-b591-ac79bcc76674 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:51.492878 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e18939f-1d31-4c7a-b591-ac79bcc76674 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:51.630416 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2e18939f-1d31-4c7a-b591-ac79bcc76674 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:51.639281 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2e18939f-1d31-4c7a-b591-ac79bcc76674 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1521 microversion: 2.1 time: 0.161928 Sep 06 21:16:51.639861 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 243/484] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:51 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:52.327447 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-53081344-65de-4af2-bf09-395efebca102 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:52.328060 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-53081344-65de-4af2-bf09-395efebca102 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] [instance: feb89148-4abf-4f2e-aa7b-422bfa0111af] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:52.343558 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53081344-65de-4af2-bf09-395efebca102 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:52.344129 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53081344-65de-4af2-bf09-395efebca102 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:52.344591 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53081344-65de-4af2-bf09-395efebca102 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:52.345389 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53081344-65de-4af2-bf09-395efebca102 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:52.345887 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53081344-65de-4af2-bf09-395efebca102 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:52.346342 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53081344-65de-4af2-bf09-395efebca102 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:52.360280 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-53081344-65de-4af2-bf09-395efebca102 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] HTTP exception thrown: Instance feb89148-4abf-4f2e-aa7b-422bfa0111af could not be found. Sep 06 21:16:52.361946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-53081344-65de-4af2-bf09-395efebca102 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Request method failure captured: Sep 06 21:16:52.361946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af HTTP/1.1 Sep 06 21:16:52.361946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 06 21:16:52.361946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 06 21:16:52.361946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Connection: close Sep 06 21:16:52.361946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 06 21:16:52.361946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 06 21:16:52.361946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Host: 10.222.0.79 Sep 06 21:16:52.361946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 06 21:16:52.361946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 06 21:16:52.361946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjF7igm2BIn_tSMyLH0D5HjKbOeGm_V1496QRloEDQYcr9tR06E60P8nArxky5T0u9dRK0H4b-ZHqE_sQPlhHRgzg7S28OantOwYuzUbuRq8dgmY4-oL33cfz3wTxl2Zu2LHd3T6yPvENdatfF4mbEZl1R1VyFjDdFQSDXHIOnCfUa5cU Sep 06 21:16:52.361946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 06 21:16:52.361946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 06 21:16:52.361946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 06 21:16:52.361946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 06 21:16:52.361946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 06 21:16:52.361946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 06 21:16:52.361946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Id: acf9183eeeef40f7a99a49d0abfeffa6 Sep 06 21:16:52.361946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesNegativeTest-405369842 Sep 06 21:16:52.361946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Role: reader,member Sep 06 21:16:52.361946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Sep 06 21:16:52.363532 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/acf9183eeeef40f7a99a49d0abfeffa6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_acf9183eeeef40f7a99a49d0abfeffa6", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/acf9183eeeef40f7a99a49d0abfeffa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/acf9183eeeef40f7a99a49d0abfeffa6"}]}] Sep 06 21:16:52.363532 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-VolumesNegativeTest-405369842 Sep 06 21:16:52.363532 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Id: acf9183eeeef40f7a99a49d0abfeffa6 Sep 06 21:16:52.363532 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesNegativeTest-405369842 Sep 06 21:16:52.363532 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User: tempest-VolumesNegativeTest-405369842-project Sep 06 21:16:52.363532 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 06 21:16:52.363532 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 06 21:16:52.363532 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Id: 8dd7bb424a25489db00059483f558b9a Sep 06 21:16:52.363532 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-VolumesNegativeTest-405369842-project Sep 06 21:16:52.363532 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: method: > Sep 06 21:16:52.363532 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: exception: Instance feb89148-4abf-4f2e-aa7b-422bfa0111af could not be found. Sep 06 21:16:52.363532 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: action_args: {'id': 'feb89148-4abf-4f2e-aa7b-422bfa0111af'} Sep 06 21:16:52.364394 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:16:52.364394 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:16:52.364394 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:16:52.364394 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:16:52.364394 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:16:52.364394 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:16:52.364394 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:16:52.364394 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:16:52.364394 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:16:52.364394 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:16:52.364394 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feb89148-4abf-4f2e-aa7b-422bfa0111af could not be found. Sep 06 21:16:52.364394 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:16:52.364394 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:16:52.364394 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:16:52.364394 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:16:52.364394 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:16:52.364394 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:16:52.364394 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:16:52.364394 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:16:52.364394 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:16:52.365853 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:16:52.365853 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:16:52.365853 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:16:52.365853 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:16:52.365853 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:16:52.365853 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:16:52.365853 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:16:52.365853 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feb89148-4abf-4f2e-aa7b-422bfa0111af could not be found. Sep 06 21:16:52.365853 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:16:52.365853 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:16:52.365853 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:16:52.365853 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:16:52.365853 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:16:52.365853 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:16:52.365853 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:16:52.365853 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:16:52.365853 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feb89148-4abf-4f2e-aa7b-422bfa0111af could not be found. Sep 06 21:16:52.365853 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:16:52.367509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-53081344-65de-4af2-bf09-395efebca102 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] Returning 404 to user: Instance feb89148-4abf-4f2e-aa7b-422bfa0111af could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:16:52.367509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-53081344-65de-4af2-bf09-395efebca102 tempest-VolumesNegativeTest-405369842 tempest-VolumesNegativeTest-405369842-project] 10.222.0.79 "GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af" status: 404 len: 111 microversion: 2.1 time: 0.039758 Sep 06 21:16:52.367509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 242/485] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:52 2022] GET /compute/v2.1/servers/feb89148-4abf-4f2e-aa7b-422bfa0111af => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:16:52.664599 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a5654820-3401-4c3f-84c9-70b5e087175a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:52.665379 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a5654820-3401-4c3f-84c9-70b5e087175a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:52.672263 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5654820-3401-4c3f-84c9-70b5e087175a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:52.672772 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5654820-3401-4c3f-84c9-70b5e087175a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:52.673484 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5654820-3401-4c3f-84c9-70b5e087175a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:52.674729 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5654820-3401-4c3f-84c9-70b5e087175a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:52.675180 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5654820-3401-4c3f-84c9-70b5e087175a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:52.676230 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5654820-3401-4c3f-84c9-70b5e087175a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:52.875765 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a5654820-3401-4c3f-84c9-70b5e087175a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:52.887619 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a5654820-3401-4c3f-84c9-70b5e087175a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1501 microversion: 2.1 time: 0.227386 Sep 06 21:16:52.904932 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 244/486] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:52 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1501 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:52.914242 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ea3c473e-b316-4590-b650-bea5e6fe15e5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fa3f953-84ec-425a-afbe-a71bb292af67"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:16:52.917221 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ea3c473e-b316-4590-b650-bea5e6fe15e5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:52.930181 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea3c473e-b316-4590-b650-bea5e6fe15e5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:52.930760 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea3c473e-b316-4590-b650-bea5e6fe15e5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:52.931282 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea3c473e-b316-4590-b650-bea5e6fe15e5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:52.932342 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea3c473e-b316-4590-b650-bea5e6fe15e5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:52.932984 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea3c473e-b316-4590-b650-bea5e6fe15e5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:52.933636 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea3c473e-b316-4590-b650-bea5e6fe15e5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:52.963618 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-ea3c473e-b316-4590-b650-bea5e6fe15e5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] HTTP exception thrown: Cannot 'attach_volume' instance e4f062bd-6aa2-4c00-86a3-7ddc003c1713 while it is in vm_state rescued Sep 06 21:16:52.965606 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ea3c473e-b316-4590-b650-bea5e6fe15e5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Request method failure captured: Sep 06 21:16:52.965606 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713/os-volume_attachments HTTP/1.1 Sep 06 21:16:52.965606 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 06 21:16:52.965606 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 06 21:16:52.965606 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Connection: close Sep 06 21:16:52.965606 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Length: 74 Sep 06 21:16:52.965606 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 06 21:16:52.965606 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Host: 10.222.0.79 Sep 06 21:16:52.965606 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 06 21:16:52.965606 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 06 21:16:52.965606 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjF7gUN_FLSnpNG9HSuch7Adumi07PvDapiWYlb4hdEBJJ-3oDVKZT8eH0XUiQphynu_EAk0GMMbuGt07jVLp2XHuc-gGocBp-HoFX8pN_ZBw-uxiJnYglnmqkenrCvYYKoQN5M4O4ySALb1G6TjikmxU7GQJcI9jL4bBNWv5FzOObxk8 Sep 06 21:16:52.965606 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 06 21:16:52.965606 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 06 21:16:52.965606 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 06 21:16:52.965606 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 06 21:16:52.965606 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 06 21:16:52.965606 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 06 21:16:52.965606 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Id: ff397d6b3f4a42bf8b68b3bc55600dba Sep 06 21:16:52.965606 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-456052109 Sep 06 21:16:52.965606 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Role: reader,member Sep 06 21:16:52.965606 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Sep 06 21:16:52.967292 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ff397d6b3f4a42bf8b68b3bc55600dba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ff397d6b3f4a42bf8b68b3bc55600dba", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ff397d6b3f4a42bf8b68b3bc55600dba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ff397d6b3f4a42bf8b68b3bc55600dba"}]}] Sep 06 21:16:52.967292 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-ServerRescueNegativeTestJSON-456052109 Sep 06 21:16:52.967292 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Id: ff397d6b3f4a42bf8b68b3bc55600dba Sep 06 21:16:52.967292 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-456052109 Sep 06 21:16:52.967292 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User: tempest-ServerRescueNegativeTestJSON-456052109-project Sep 06 21:16:52.967292 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 06 21:16:52.967292 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 06 21:16:52.967292 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Id: 2ec47d6e2e9b40a6bd207c084041f7a9 Sep 06 21:16:52.967292 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-ServerRescueNegativeTestJSON-456052109-project Sep 06 21:16:52.967292 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Sep 06 21:16:52.967292 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: {"volumeAttachment": {"volumeId": "7fa3f953-84ec-425a-afbe-a71bb292af67"}} Sep 06 21:16:52.967292 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: method: > Sep 06 21:16:52.968359 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: exception: Cannot 'attach_volume' instance e4f062bd-6aa2-4c00-86a3-7ddc003c1713 while it is in vm_state rescued Sep 06 21:16:52.968359 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: action_args: {'server_id': 'e4f062bd-6aa2-4c00-86a3-7ddc003c1713', 'body': {'volumeAttachment': {'volumeId': '7fa3f953-84ec-425a-afbe-a71bb292af67'}}} Sep 06 21:16:52.968359 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:16:52.968359 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:16:52.968359 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 06 21:16:52.968359 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 06 21:16:52.968359 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 21:16:52.968359 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 21:16:52.968359 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 06 21:16:52.968359 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 21:16:52.968359 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e4f062bd-6aa2-4c00-86a3-7ddc003c1713 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 06 21:16:52.968359 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:16:52.968359 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:16:52.968359 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:16:52.968359 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:16:52.968359 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:16:52.968359 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:16:52.968359 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:16:52.968359 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:16:52.970499 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:16:52.970499 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:16:52.970499 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 21:16:52.970499 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 21:16:52.970499 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 21:16:52.970499 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 21:16:52.970499 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 21:16:52.970499 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 21:16:52.970499 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 06 21:16:52.970499 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 06 21:16:52.970499 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 21:16:52.970499 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 21:16:52.970499 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e4f062bd-6aa2-4c00-86a3-7ddc003c1713 while it is in vm_state rescued Sep 06 21:16:52.970499 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:16:52.970499 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:16:52.970499 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:16:52.970499 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:16:52.970499 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:16:52.970499 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:16:52.971614 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:16:52.971614 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:16:52.971614 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e4f062bd-6aa2-4c00-86a3-7ddc003c1713 while it is in vm_state rescued Sep 06 21:16:52.971614 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:16:52.971614 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ea3c473e-b316-4590-b650-bea5e6fe15e5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Returning 409 to user: Cannot 'attach_volume' instance e4f062bd-6aa2-4c00-86a3-7ddc003c1713 while it is in vm_state rescued {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:16:52.971614 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ea3c473e-b316-4590-b650-bea5e6fe15e5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "POST /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.059839 Sep 06 21:16:52.971614 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 243/487] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Sep 6 21:16:52 2022] POST /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713/os-volume_attachments => generated 152 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 06 21:16:52.980999 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6747e231-7bc6-49bc-a1f1-9f9fee26f4d8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:16:52.981711 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6747e231-7bc6-49bc-a1f1-9f9fee26f4d8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:52.988125 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6747e231-7bc6-49bc-a1f1-9f9fee26f4d8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:52.994661 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6747e231-7bc6-49bc-a1f1-9f9fee26f4d8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:52.995108 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6747e231-7bc6-49bc-a1f1-9f9fee26f4d8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:52.995887 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6747e231-7bc6-49bc-a1f1-9f9fee26f4d8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:52.996587 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6747e231-7bc6-49bc-a1f1-9f9fee26f4d8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:52.996761 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6747e231-7bc6-49bc-a1f1-9f9fee26f4d8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:53.094385 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6747e231-7bc6-49bc-a1f1-9f9fee26f4d8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "POST /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713/action" status: 202 len: 0 microversion: 2.1 time: 0.116902 Sep 06 21:16:53.095952 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 245/488] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Sep 6 21:16:52 2022] POST /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:16:53.103980 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c7a16ea3-e660-45d8-a836-82685843bdaf tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:53.104482 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c7a16ea3-e660-45d8-a836-82685843bdaf tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:53.111960 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7a16ea3-e660-45d8-a836-82685843bdaf tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:53.116807 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7a16ea3-e660-45d8-a836-82685843bdaf tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:53.117469 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7a16ea3-e660-45d8-a836-82685843bdaf tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:53.118589 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7a16ea3-e660-45d8-a836-82685843bdaf tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:53.121799 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7a16ea3-e660-45d8-a836-82685843bdaf tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:53.122244 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7a16ea3-e660-45d8-a836-82685843bdaf tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:53.416241 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c7a16ea3-e660-45d8-a836-82685843bdaf tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:53.427368 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c7a16ea3-e660-45d8-a836-82685843bdaf tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1509 microversion: 2.1 time: 0.327341 Sep 06 21:16:53.428695 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 244/489] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:53 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1509 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:16:54.452758 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-78e94e9a-95d9-41dc-b0aa-1e7eddfe3b8e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:54.453594 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-78e94e9a-95d9-41dc-b0aa-1e7eddfe3b8e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:54.461685 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78e94e9a-95d9-41dc-b0aa-1e7eddfe3b8e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:54.462174 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78e94e9a-95d9-41dc-b0aa-1e7eddfe3b8e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:54.462613 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78e94e9a-95d9-41dc-b0aa-1e7eddfe3b8e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:54.463316 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78e94e9a-95d9-41dc-b0aa-1e7eddfe3b8e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:54.467338 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78e94e9a-95d9-41dc-b0aa-1e7eddfe3b8e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:54.468060 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78e94e9a-95d9-41dc-b0aa-1e7eddfe3b8e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:54.672006 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-78e94e9a-95d9-41dc-b0aa-1e7eddfe3b8e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:54.681116 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-78e94e9a-95d9-41dc-b0aa-1e7eddfe3b8e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1509 microversion: 2.1 time: 0.233185 Sep 06 21:16:54.681692 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 246/490] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:54 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1509 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:55.706593 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6e897875-c92a-495f-b1a4-8e58a184b1fb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:55.707208 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6e897875-c92a-495f-b1a4-8e58a184b1fb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:55.718006 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e897875-c92a-495f-b1a4-8e58a184b1fb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:55.718492 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e897875-c92a-495f-b1a4-8e58a184b1fb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:55.718929 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e897875-c92a-495f-b1a4-8e58a184b1fb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:55.719638 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e897875-c92a-495f-b1a4-8e58a184b1fb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:55.720086 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e897875-c92a-495f-b1a4-8e58a184b1fb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:55.720510 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e897875-c92a-495f-b1a4-8e58a184b1fb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:56.003973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6e897875-c92a-495f-b1a4-8e58a184b1fb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:56.012102 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6e897875-c92a-495f-b1a4-8e58a184b1fb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1509 microversion: 2.1 time: 0.310689 Sep 06 21:16:56.012698 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 245/491] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:55 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1509 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:57.036053 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-01bddb20-42ee-42e8-960f-1a714d1b12ec tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:57.037008 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-01bddb20-42ee-42e8-960f-1a714d1b12ec tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:57.045068 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01bddb20-42ee-42e8-960f-1a714d1b12ec tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:57.046260 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01bddb20-42ee-42e8-960f-1a714d1b12ec tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:57.046854 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01bddb20-42ee-42e8-960f-1a714d1b12ec tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:57.047752 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01bddb20-42ee-42e8-960f-1a714d1b12ec tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:57.048260 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01bddb20-42ee-42e8-960f-1a714d1b12ec tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:57.049226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01bddb20-42ee-42e8-960f-1a714d1b12ec tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:57.227936 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-01bddb20-42ee-42e8-960f-1a714d1b12ec tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:57.236612 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-01bddb20-42ee-42e8-960f-1a714d1b12ec tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1509 microversion: 2.1 time: 0.204608 Sep 06 21:16:57.238341 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 247/492] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:57 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1509 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:16:58.262131 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5132a4e9-0a6e-4b0e-b863-4ab74ef1f2df tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:16:58.262744 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5132a4e9-0a6e-4b0e-b863-4ab74ef1f2df tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:16:58.269116 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5132a4e9-0a6e-4b0e-b863-4ab74ef1f2df tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:58.269724 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5132a4e9-0a6e-4b0e-b863-4ab74ef1f2df tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:58.270266 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5132a4e9-0a6e-4b0e-b863-4ab74ef1f2df tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:58.271039 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5132a4e9-0a6e-4b0e-b863-4ab74ef1f2df tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:16:58.271613 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5132a4e9-0a6e-4b0e-b863-4ab74ef1f2df tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:16:58.272174 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5132a4e9-0a6e-4b0e-b863-4ab74ef1f2df tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:16:58.415939 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5132a4e9-0a6e-4b0e-b863-4ab74ef1f2df tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:16:58.424973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5132a4e9-0a6e-4b0e-b863-4ab74ef1f2df tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1515 microversion: 2.1 time: 0.166747 Sep 06 21:16:58.425558 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 246/493] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:16:58 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:17:07.275597 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6c7dbc92-86a4-421b-b0b6-30b0cb78fe34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Action: 'create', calling method: .version_select at 0x7f04ce67e9d0>, body: {"keypair": {"name": "tempest-keypair-907304961", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK06+BQzy3L2uQ1sHcMgkJsgc+4XpDv1+jMytiDQktM3jVpt3Gx6jqlAptK2UMbL2eVUlCPrfVrdh6e1oPOBvM3LdR6E4yRP2HPq17pP7ypmS04vOiUfS7ELxNGKDvEs3g=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:17:07.283011 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=11 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:17:07.284081 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:17:07.297488 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-6c7dbc92-86a4-421b-b0b6-30b0cb78fe34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Getting quotas for project ff397d6b3f4a42bf8b68b3bc55600dba. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:17:07.302784 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-6c7dbc92-86a4-421b-b0b6-30b0cb78fe34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Getting quotas for user 2ec47d6e2e9b40a6bd207c084041f7a9 and project ff397d6b3f4a42bf8b68b3bc55600dba. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:17:07.318899 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6c7dbc92-86a4-421b-b0b6-30b0cb78fe34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [8707d9d8-c38f-4a29-975f-7f51aa5ae215] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 06 21:17:08.327177 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [None req-6c7dbc92-86a4-421b-b0b6-30b0cb78fe34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [8707d9d8-c38f-4a29-975f-7f51aa5ae215] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 34924. Sep 06 21:17:08.361300 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6c7dbc92-86a4-421b-b0b6-30b0cb78fe34 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.090080 Sep 06 21:17:08.362639 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 248/494] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Sep 6 21:17:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:17:10.054987 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=19 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:17:10.055890 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=64 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:17:10.231164 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8a476818-25d1-4ba2-87eb-03276843b686 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-398848048", "imageRef": "8b4a7612-517c-4711-8637-36b221338f65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ebd3cadb-0399-42a5-9075-83a55d051ee3"}], "security_groups": [{"name": "tempest-securitygroup--596311624"}], "key_name": "tempest-keypair-907304961", "user_data": "}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:17:10.270145 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c1ecb255-f8fe-45b8-9259-fbcadfa684b8 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Action: 'create', calling method: .version_select at 0x7f04cea8fb80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1275668507", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkezqBgBwktyaEjRfACn5/Wk9qIC4JqBFapLjLIr59NokPgatVrneqROrwNQAxg6TIsCJpu3vrNmY6436zCPNWXSTdKuGGuLDMbSaH52Xik1j8HImnnRBrIZHrAQk1JEw=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:17:10.290275 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-c1ecb255-f8fe-45b8-9259-fbcadfa684b8 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Getting quotas for project 5801984f41a043daa52dbef9de89df9a. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:17:10.295975 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-c1ecb255-f8fe-45b8-9259-fbcadfa684b8 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Getting quotas for user 6d0c1c510b0a4fa39927f7f92352d034 and project 5801984f41a043daa52dbef9de89df9a. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:17:10.342645 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c1ecb255-f8fe-45b8-9259-fbcadfa684b8 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.293956 Sep 06 21:17:10.343274 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 247/495] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Sep 6 21:17:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:17:10.372097 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-8a476818-25d1-4ba2-87eb-03276843b686 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] validate_networks() for [('ebd3cadb-0399-42a5-9075-83a55d051ee3', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 21:17:10.945313 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-8a476818-25d1-4ba2-87eb-03276843b686 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 21:17:10.945736 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-8a476818-25d1-4ba2-87eb-03276843b686 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 21:17:10.946215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-8a476818-25d1-4ba2-87eb-03276843b686 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 21:17:10.946656 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-8a476818-25d1-4ba2-87eb-03276843b686 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 21:17:10.947065 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-8a476818-25d1-4ba2-87eb-03276843b686 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 21:17:10.956690 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a476818-25d1-4ba2-87eb-03276843b686 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:10.957212 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a476818-25d1-4ba2-87eb-03276843b686 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:10.957628 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a476818-25d1-4ba2-87eb-03276843b686 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:10.958363 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a476818-25d1-4ba2-87eb-03276843b686 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:10.958808 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a476818-25d1-4ba2-87eb-03276843b686 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:10.959230 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8a476818-25d1-4ba2-87eb-03276843b686 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:10.977550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-8a476818-25d1-4ba2-87eb-03276843b686 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Getting quotas for project ff397d6b3f4a42bf8b68b3bc55600dba. Resources: {'ram', 'cores', 'instances'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:17:10.981994 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-8a476818-25d1-4ba2-87eb-03276843b686 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Getting quotas for user 2ec47d6e2e9b40a6bd207c084041f7a9 and project ff397d6b3f4a42bf8b68b3bc55600dba. Resources: {'ram', 'cores', 'instances'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:17:10.994373 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8a476818-25d1-4ba2-87eb-03276843b686 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 21:17:10.997097 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8a476818-25d1-4ba2-87eb-03276843b686 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8b4a7612-517c-4711-8637-36b221338f65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 21:17:11.043958 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8a476818-25d1-4ba2-87eb-03276843b686 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [a8584c25-fc56-45ef-b2ee-4f6854db0543] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 06 21:17:12.052704 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [None req-8a476818-25d1-4ba2-87eb-03276843b686 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [a8584c25-fc56-45ef-b2ee-4f6854db0543] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 35034. Sep 06 21:17:12.057062 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8a476818-25d1-4ba2-87eb-03276843b686 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.830343 Sep 06 21:17:12.057757 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 249/496] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Sep 6 21:17:10 2022] POST /compute/v2.1/servers => generated 408 bytes in 1832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 21:17:12.069685 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-48467c71-a96a-469a-9f4a-fa1b1137a055 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:17:12.071056 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-48467c71-a96a-469a-9f4a-fa1b1137a055 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:17:12.135836 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-48467c71-a96a-469a-9f4a-fa1b1137a055 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:17:12.150303 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-48467c71-a96a-469a-9f4a-fa1b1137a055 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1244 microversion: 2.1 time: 0.083439 Sep 06 21:17:12.151228 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 248/497] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:17:12 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:17:13.185818 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a54d536c-1ebd-4cb9-ba6d-fd280ba1c762 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:17:13.186455 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a54d536c-1ebd-4cb9-ba6d-fd280ba1c762 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:17:13.195085 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a54d536c-1ebd-4cb9-ba6d-fd280ba1c762 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:13.195941 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a54d536c-1ebd-4cb9-ba6d-fd280ba1c762 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:13.196447 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a54d536c-1ebd-4cb9-ba6d-fd280ba1c762 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:13.197303 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a54d536c-1ebd-4cb9-ba6d-fd280ba1c762 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:13.197969 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a54d536c-1ebd-4cb9-ba6d-fd280ba1c762 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:13.198739 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a54d536c-1ebd-4cb9-ba6d-fd280ba1c762 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:13.270375 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a54d536c-1ebd-4cb9-ba6d-fd280ba1c762 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:17:13.278962 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a54d536c-1ebd-4cb9-ba6d-fd280ba1c762 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1296 microversion: 2.1 time: 0.103759 Sep 06 21:17:13.279856 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 250/498] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:17:13 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1296 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:17:14.303831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4937660a-03e2-43ac-b4cd-b8b691b274a8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:17:14.304579 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4937660a-03e2-43ac-b4cd-b8b691b274a8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:17:14.311636 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4937660a-03e2-43ac-b4cd-b8b691b274a8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:14.312252 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4937660a-03e2-43ac-b4cd-b8b691b274a8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:14.312854 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4937660a-03e2-43ac-b4cd-b8b691b274a8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:14.313667 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4937660a-03e2-43ac-b4cd-b8b691b274a8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:14.314242 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4937660a-03e2-43ac-b4cd-b8b691b274a8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:14.314770 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4937660a-03e2-43ac-b4cd-b8b691b274a8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:14.427149 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4937660a-03e2-43ac-b4cd-b8b691b274a8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:17:14.449446 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4937660a-03e2-43ac-b4cd-b8b691b274a8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1302 microversion: 2.1 time: 0.148547 Sep 06 21:17:14.455452 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 249/499] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:17:14 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1302 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:17:15.479988 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6ab22e40-b4d2-4d2f-a828-b5056e991585 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:17:15.480597 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6ab22e40-b4d2-4d2f-a828-b5056e991585 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:17:15.487279 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ab22e40-b4d2-4d2f-a828-b5056e991585 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:15.487764 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ab22e40-b4d2-4d2f-a828-b5056e991585 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:15.488196 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ab22e40-b4d2-4d2f-a828-b5056e991585 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:15.488923 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ab22e40-b4d2-4d2f-a828-b5056e991585 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:15.489378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ab22e40-b4d2-4d2f-a828-b5056e991585 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:15.489845 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ab22e40-b4d2-4d2f-a828-b5056e991585 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:15.677147 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6ab22e40-b4d2-4d2f-a828-b5056e991585 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:17:15.687308 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6ab22e40-b4d2-4d2f-a828-b5056e991585 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1369 microversion: 2.1 time: 0.211227 Sep 06 21:17:15.687891 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 251/500] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:17:15 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1369 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:17:15.844230 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-63b229dc-209b-4a9b-bf8a-39a58843de8b req-d1b84207-4c9e-4bf8-949f-4546acfeec40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62f05cca-d038-4795-a189-bc7aa10064ac", "tag": "6ae70e6c-1486-49e9-ba26-6e0a2ae18f0e"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:17:15.860906 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-63b229dc-209b-4a9b-bf8a-39a58843de8b req-d1b84207-4c9e-4bf8-949f-4546acfeec40 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:15.861389 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-63b229dc-209b-4a9b-bf8a-39a58843de8b req-d1b84207-4c9e-4bf8-949f-4546acfeec40 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:15.867943 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-63b229dc-209b-4a9b-bf8a-39a58843de8b req-d1b84207-4c9e-4bf8-949f-4546acfeec40 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:15.880968 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-63b229dc-209b-4a9b-bf8a-39a58843de8b req-d1b84207-4c9e-4bf8-949f-4546acfeec40 service nova] Creating event network-changed:6ae70e6c-1486-49e9-ba26-6e0a2ae18f0e for instance 62f05cca-d038-4795-a189-bc7aa10064ac on hv-cinder-74915 Sep 06 21:17:15.886686 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-63b229dc-209b-4a9b-bf8a-39a58843de8b req-d1b84207-4c9e-4bf8-949f-4546acfeec40 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045960 Sep 06 21:17:15.888868 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 250/501] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:17:16.711538 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1ae079bf-3cbd-4b89-94fe-e203f0e60d94 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:17:16.712143 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1ae079bf-3cbd-4b89-94fe-e203f0e60d94 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:17:16.725703 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ae079bf-3cbd-4b89-94fe-e203f0e60d94 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:16.726195 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ae079bf-3cbd-4b89-94fe-e203f0e60d94 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:16.726934 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ae079bf-3cbd-4b89-94fe-e203f0e60d94 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:16.728933 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ae079bf-3cbd-4b89-94fe-e203f0e60d94 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:16.731192 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ae079bf-3cbd-4b89-94fe-e203f0e60d94 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:16.732028 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ae079bf-3cbd-4b89-94fe-e203f0e60d94 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:16.941918 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1ae079bf-3cbd-4b89-94fe-e203f0e60d94 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:17:16.953432 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1ae079bf-3cbd-4b89-94fe-e203f0e60d94 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1369 microversion: 2.1 time: 0.246007 Sep 06 21:17:16.954016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 252/502] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:17:16 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1369 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:17:17.978717 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e4a47d48-581f-4101-bd6c-7932437098b3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:17:17.980237 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e4a47d48-581f-4101-bd6c-7932437098b3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:17:17.988774 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4a47d48-581f-4101-bd6c-7932437098b3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:17.989507 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4a47d48-581f-4101-bd6c-7932437098b3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:17.990610 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4a47d48-581f-4101-bd6c-7932437098b3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:17.991555 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4a47d48-581f-4101-bd6c-7932437098b3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:17.992155 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4a47d48-581f-4101-bd6c-7932437098b3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:17.992733 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4a47d48-581f-4101-bd6c-7932437098b3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:18.151465 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e4a47d48-581f-4101-bd6c-7932437098b3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:17:18.159810 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e4a47d48-581f-4101-bd6c-7932437098b3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1369 microversion: 2.1 time: 0.186171 Sep 06 21:17:18.160635 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 251/503] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:17:17 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1369 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:17:19.186643 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9afcf994-4573-4942-b01c-cd3029901c79 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:17:19.188425 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9afcf994-4573-4942-b01c-cd3029901c79 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:17:19.198751 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9afcf994-4573-4942-b01c-cd3029901c79 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:19.199412 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9afcf994-4573-4942-b01c-cd3029901c79 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:19.200859 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9afcf994-4573-4942-b01c-cd3029901c79 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:19.201817 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9afcf994-4573-4942-b01c-cd3029901c79 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:19.203090 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9afcf994-4573-4942-b01c-cd3029901c79 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:19.203826 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9afcf994-4573-4942-b01c-cd3029901c79 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:19.417839 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9afcf994-4573-4942-b01c-cd3029901c79 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:17:19.429016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9afcf994-4573-4942-b01c-cd3029901c79 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1369 microversion: 2.1 time: 0.248156 Sep 06 21:17:19.430215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 253/504] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:17:19 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1369 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:17:20.460399 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f8addd85-0ded-440b-beb2-238de5a2e533 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:17:20.461053 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f8addd85-0ded-440b-beb2-238de5a2e533 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:17:20.476182 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8addd85-0ded-440b-beb2-238de5a2e533 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:20.480275 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8addd85-0ded-440b-beb2-238de5a2e533 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:20.480958 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8addd85-0ded-440b-beb2-238de5a2e533 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:20.482185 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8addd85-0ded-440b-beb2-238de5a2e533 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:20.485305 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8addd85-0ded-440b-beb2-238de5a2e533 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:20.485755 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8addd85-0ded-440b-beb2-238de5a2e533 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:20.737341 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f8addd85-0ded-440b-beb2-238de5a2e533 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:17:20.759046 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f8addd85-0ded-440b-beb2-238de5a2e533 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1369 microversion: 2.1 time: 0.303821 Sep 06 21:17:20.759940 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 252/505] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:17:20 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1369 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:17:21.783630 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6a58d13b-842f-4388-9be7-693d61a82bb3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:17:21.784811 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6a58d13b-842f-4388-9be7-693d61a82bb3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:17:21.796928 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:17:21.800480 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=10 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:17:21.805094 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a58d13b-842f-4388-9be7-693d61a82bb3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:21.805583 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a58d13b-842f-4388-9be7-693d61a82bb3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:21.806019 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a58d13b-842f-4388-9be7-693d61a82bb3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:21.806843 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a58d13b-842f-4388-9be7-693d61a82bb3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:21.807157 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a58d13b-842f-4388-9be7-693d61a82bb3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:21.807788 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a58d13b-842f-4388-9be7-693d61a82bb3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:22.131623 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6a58d13b-842f-4388-9be7-693d61a82bb3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:17:22.142286 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6a58d13b-842f-4388-9be7-693d61a82bb3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1369 microversion: 2.1 time: 0.363632 Sep 06 21:17:22.149601 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 254/506] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:17:21 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1369 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:17:23.171083 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7e6a25b5-4569-4807-b37c-b82bb7b39850 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:17:23.171691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7e6a25b5-4569-4807-b37c-b82bb7b39850 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:17:23.181105 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:17:23.184931 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e6a25b5-4569-4807-b37c-b82bb7b39850 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:23.187596 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e6a25b5-4569-4807-b37c-b82bb7b39850 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:23.189004 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e6a25b5-4569-4807-b37c-b82bb7b39850 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:23.197392 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e6a25b5-4569-4807-b37c-b82bb7b39850 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:23.200501 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e6a25b5-4569-4807-b37c-b82bb7b39850 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:23.201580 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e6a25b5-4569-4807-b37c-b82bb7b39850 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:23.487166 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7e6a25b5-4569-4807-b37c-b82bb7b39850 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:17:23.495960 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7e6a25b5-4569-4807-b37c-b82bb7b39850 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1369 microversion: 2.1 time: 0.329905 Sep 06 21:17:23.516038 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 253/507] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:17:23 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1369 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:17:23.655201 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-48451caf-4beb-4de3-8f65-3eab0ba76c3a req-8eb05b9f-13dd-401d-90b1-913ee4ef9ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f05cca-d038-4795-a189-bc7aa10064ac", "name": "network-vif-plugged", "status": "completed", "tag": "6ae70e6c-1486-49e9-ba26-6e0a2ae18f0e"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:17:23.670661 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-48451caf-4beb-4de3-8f65-3eab0ba76c3a req-8eb05b9f-13dd-401d-90b1-913ee4ef9ad0 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:23.671308 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-48451caf-4beb-4de3-8f65-3eab0ba76c3a req-8eb05b9f-13dd-401d-90b1-913ee4ef9ad0 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:23.671819 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-48451caf-4beb-4de3-8f65-3eab0ba76c3a req-8eb05b9f-13dd-401d-90b1-913ee4ef9ad0 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:23.687550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-48451caf-4beb-4de3-8f65-3eab0ba76c3a req-8eb05b9f-13dd-401d-90b1-913ee4ef9ad0 service nova] Creating event network-vif-plugged:6ae70e6c-1486-49e9-ba26-6e0a2ae18f0e for instance 62f05cca-d038-4795-a189-bc7aa10064ac on hv-cinder-74915 Sep 06 21:17:23.700356 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-48451caf-4beb-4de3-8f65-3eab0ba76c3a req-8eb05b9f-13dd-401d-90b1-913ee4ef9ad0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049478 Sep 06 21:17:23.702257 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 255/508] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 21:17:24.521934 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4e67c98d-88be-46c9-96ca-73b4cb53ece8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:17:24.524167 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4e67c98d-88be-46c9-96ca-73b4cb53ece8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:17:24.532192 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e67c98d-88be-46c9-96ca-73b4cb53ece8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:24.533359 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e67c98d-88be-46c9-96ca-73b4cb53ece8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:24.534662 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e67c98d-88be-46c9-96ca-73b4cb53ece8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:24.535916 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e67c98d-88be-46c9-96ca-73b4cb53ece8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:24.536797 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e67c98d-88be-46c9-96ca-73b4cb53ece8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:24.537522 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e67c98d-88be-46c9-96ca-73b4cb53ece8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:25.107881 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4e67c98d-88be-46c9-96ca-73b4cb53ece8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:17:25.120648 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4e67c98d-88be-46c9-96ca-73b4cb53ece8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1369 microversion: 2.1 time: 0.598839 Sep 06 21:17:25.121556 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 254/509] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:17:24 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1369 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:17:26.146584 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a3a46bae-f3d3-4a8d-b039-fccaecda786e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:17:26.147570 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a3a46bae-f3d3-4a8d-b039-fccaecda786e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:17:26.167510 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3a46bae-f3d3-4a8d-b039-fccaecda786e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:26.168320 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3a46bae-f3d3-4a8d-b039-fccaecda786e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:26.169490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3a46bae-f3d3-4a8d-b039-fccaecda786e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:26.174858 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3a46bae-f3d3-4a8d-b039-fccaecda786e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:26.175983 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3a46bae-f3d3-4a8d-b039-fccaecda786e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:26.176726 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3a46bae-f3d3-4a8d-b039-fccaecda786e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:26.651497 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a3a46bae-f3d3-4a8d-b039-fccaecda786e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:17:26.666102 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a3a46bae-f3d3-4a8d-b039-fccaecda786e tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1369 microversion: 2.1 time: 0.523159 Sep 06 21:17:26.670328 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 256/510] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:17:26 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1369 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:17:26.884879 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3493b524-5c6b-4606-9f9e-b48c97703a6f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2eb3cbb-4c84-4bb8-9218-e00be70036e5", "device": "/dev/sdb"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:17:26.889122 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3493b524-5c6b-4606-9f9e-b48c97703a6f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:17:26.900592 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3493b524-5c6b-4606-9f9e-b48c97703a6f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:26.901129 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3493b524-5c6b-4606-9f9e-b48c97703a6f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:26.901564 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3493b524-5c6b-4606-9f9e-b48c97703a6f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:26.902395 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3493b524-5c6b-4606-9f9e-b48c97703a6f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:26.902836 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3493b524-5c6b-4606-9f9e-b48c97703a6f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:26.914833 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3493b524-5c6b-4606-9f9e-b48c97703a6f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:27.453649 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3493b524-5c6b-4606-9f9e-b48c97703a6f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "POST /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.572867 Sep 06 21:17:27.460109 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 255/511] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Sep 6 21:17:26 2022] POST /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2/os-volume_attachments => generated 194 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 21:17:27.693395 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-db2370bc-e9f0-4602-8169-f7fee14287c6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:17:27.694022 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-db2370bc-e9f0-4602-8169-f7fee14287c6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:17:27.709743 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db2370bc-e9f0-4602-8169-f7fee14287c6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:27.710249 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db2370bc-e9f0-4602-8169-f7fee14287c6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:27.710705 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db2370bc-e9f0-4602-8169-f7fee14287c6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:27.711417 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db2370bc-e9f0-4602-8169-f7fee14287c6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:27.711867 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db2370bc-e9f0-4602-8169-f7fee14287c6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:27.712285 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-db2370bc-e9f0-4602-8169-f7fee14287c6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:28.014415 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-db2370bc-e9f0-4602-8169-f7fee14287c6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:17:28.024545 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-db2370bc-e9f0-4602-8169-f7fee14287c6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1563 microversion: 2.1 time: 0.337268 Sep 06 21:17:28.025169 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 257/512] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:17:27 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1563 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:17:28.052627 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-474a4275-d7e1-43f2-aa01-d179664305d1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:17:28.054328 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-474a4275-d7e1-43f2-aa01-d179664305d1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:17:28.062703 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-474a4275-d7e1-43f2-aa01-d179664305d1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:28.063563 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-474a4275-d7e1-43f2-aa01-d179664305d1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:28.064375 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-474a4275-d7e1-43f2-aa01-d179664305d1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:28.066188 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-474a4275-d7e1-43f2-aa01-d179664305d1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:28.067065 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-474a4275-d7e1-43f2-aa01-d179664305d1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:28.068071 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-474a4275-d7e1-43f2-aa01-d179664305d1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:28.179896 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-474a4275-d7e1-43f2-aa01-d179664305d1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.134460 Sep 06 21:17:28.180481 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 256/513] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Sep 6 21:17:28 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac/os-interface => generated 285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:17:30.172469 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-01dd974e-94be-470d-b754-47167450e367 req-a582c456-0235-455d-83cc-62f630bd10e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62f05cca-d038-4795-a189-bc7aa10064ac", "tag": "6ae70e6c-1486-49e9-ba26-6e0a2ae18f0e"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:17:30.196154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-01dd974e-94be-470d-b754-47167450e367 req-a582c456-0235-455d-83cc-62f630bd10e7 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:30.198177 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-01dd974e-94be-470d-b754-47167450e367 req-a582c456-0235-455d-83cc-62f630bd10e7 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:30.199137 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-01dd974e-94be-470d-b754-47167450e367 req-a582c456-0235-455d-83cc-62f630bd10e7 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:30.229646 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-01dd974e-94be-470d-b754-47167450e367 req-a582c456-0235-455d-83cc-62f630bd10e7 service nova] Creating event network-changed:6ae70e6c-1486-49e9-ba26-6e0a2ae18f0e for instance 62f05cca-d038-4795-a189-bc7aa10064ac on hv-cinder-74915 Sep 06 21:17:30.237658 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-01dd974e-94be-470d-b754-47167450e367 req-a582c456-0235-455d-83cc-62f630bd10e7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070748 Sep 06 21:17:30.238717 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 258/514] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:17:31.627463 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b3cb7e3f-54eb-4dd1-be8a-6c17c3350a6a tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Action: 'create', calling method: .version_select at 0x7f04ce672a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1733900156", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdhAKk2lYiDhDf9XrXs6DuuUqIpdfBlqvVsCc1ffhGnkXOsHpH3zMLAB1LLsLBs28yEjAlTEa12/teTNyYhgrZAnMHHVP4k2OesxENA3YtvW9L2qwDdmHNkCvpL3i/OYg=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:17:31.644353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-b3cb7e3f-54eb-4dd1-be8a-6c17c3350a6a tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Getting quotas for project fd90c9c3a5554874b6b1d2e5d32d11f9. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:17:31.649062 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-b3cb7e3f-54eb-4dd1-be8a-6c17c3350a6a tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Getting quotas for user b9d62ee769bb4097b02703cca87ee6f4 and project fd90c9c3a5554874b6b1d2e5d32d11f9. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:17:31.673287 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b3cb7e3f-54eb-4dd1-be8a-6c17c3350a6a tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.276532 Sep 06 21:17:31.674729 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 257/515] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Sep 6 21:17:31 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:17:56.837138 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:17:56.837892 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=48 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:17:56.842542 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fc4055be-7eaa-4c04-a2d9-0d698d8c4121 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-290379854", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1275668507", "security_groups": [{"name": "tempest-secgroup-smoke-925187046"}], "block_device_mapping_v2": [{"uuid": "9e877a0f-7052-4a60-9489-ff565d3d09c0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a5bbf437-763d-4024-8517-0795a424e454"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:17:56.966456 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-fc4055be-7eaa-4c04-a2d9-0d698d8c4121 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] validate_networks() for [('a5bbf437-763d-4024-8517-0795a424e454', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 21:17:57.584945 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-fc4055be-7eaa-4c04-a2d9-0d698d8c4121 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 21:17:57.585372 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-fc4055be-7eaa-4c04-a2d9-0d698d8c4121 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 21:17:57.585845 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-fc4055be-7eaa-4c04-a2d9-0d698d8c4121 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 21:17:57.586251 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-fc4055be-7eaa-4c04-a2d9-0d698d8c4121 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 21:17:57.586795 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-fc4055be-7eaa-4c04-a2d9-0d698d8c4121 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 21:17:57.597054 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc4055be-7eaa-4c04-a2d9-0d698d8c4121 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:57.597537 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc4055be-7eaa-4c04-a2d9-0d698d8c4121 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:57.597961 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc4055be-7eaa-4c04-a2d9-0d698d8c4121 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:57.598950 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc4055be-7eaa-4c04-a2d9-0d698d8c4121 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:57.599406 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc4055be-7eaa-4c04-a2d9-0d698d8c4121 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:57.599836 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc4055be-7eaa-4c04-a2d9-0d698d8c4121 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:57.618455 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-fc4055be-7eaa-4c04-a2d9-0d698d8c4121 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Getting quotas for project 5801984f41a043daa52dbef9de89df9a. Resources: {'ram', 'cores', 'instances'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:17:57.623400 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-fc4055be-7eaa-4c04-a2d9-0d698d8c4121 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Getting quotas for user 6d0c1c510b0a4fa39927f7f92352d034 and project 5801984f41a043daa52dbef9de89df9a. Resources: {'ram', 'cores', 'instances'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:17:57.684467 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fc4055be-7eaa-4c04-a2d9-0d698d8c4121 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 21:17:57.686985 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fc4055be-7eaa-4c04-a2d9-0d698d8c4121 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9e877a0f-7052-4a60-9489-ff565d3d09c0',volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 21:17:57.842609 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fc4055be-7eaa-4c04-a2d9-0d698d8c4121 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.007241 Sep 06 21:17:57.843699 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 259/516] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Sep 6 21:17:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 21:17:57.855476 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2b15d7f8-8a04-4c80-ac04-25cfc281c0a1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:17:57.856083 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2b15d7f8-8a04-4c80-ac04-25cfc281c0a1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:17:57.858977 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:17:57.859898 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:17:57.860609 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:17:57.929335 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2b15d7f8-8a04-4c80-ac04-25cfc281c0a1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:17:57.936618 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2b15d7f8-8a04-4c80-ac04-25cfc281c0a1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1094 microversion: 2.1 time: 0.085124 Sep 06 21:17:57.937204 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 258/517] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:17:57 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1094 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:17:58.960159 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7e5b570a-8b47-48ed-b94d-8a20bc41ee81 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:17:58.960797 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7e5b570a-8b47-48ed-b94d-8a20bc41ee81 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:17:58.968398 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e5b570a-8b47-48ed-b94d-8a20bc41ee81 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:58.968904 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e5b570a-8b47-48ed-b94d-8a20bc41ee81 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:58.969335 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e5b570a-8b47-48ed-b94d-8a20bc41ee81 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:58.970033 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e5b570a-8b47-48ed-b94d-8a20bc41ee81 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:17:58.970483 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e5b570a-8b47-48ed-b94d-8a20bc41ee81 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:17:58.970904 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e5b570a-8b47-48ed-b94d-8a20bc41ee81 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:17:59.045277 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7e5b570a-8b47-48ed-b94d-8a20bc41ee81 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:17:59.056970 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7e5b570a-8b47-48ed-b94d-8a20bc41ee81 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1144 microversion: 2.1 time: 0.100622 Sep 06 21:17:59.057530 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 260/518] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:17:58 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1144 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:00.087206 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0a59c81c-3a4c-41a1-9c8d-ec9d11f742e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:00.088186 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0a59c81c-3a4c-41a1-9c8d-ec9d11f742e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:00.098827 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a59c81c-3a4c-41a1-9c8d-ec9d11f742e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:00.099609 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a59c81c-3a4c-41a1-9c8d-ec9d11f742e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:00.100274 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a59c81c-3a4c-41a1-9c8d-ec9d11f742e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:00.101479 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a59c81c-3a4c-41a1-9c8d-ec9d11f742e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:00.102215 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a59c81c-3a4c-41a1-9c8d-ec9d11f742e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:00.102900 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a59c81c-3a4c-41a1-9c8d-ec9d11f742e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:00.167657 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0a59c81c-3a4c-41a1-9c8d-ec9d11f742e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:00.175861 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0a59c81c-3a4c-41a1-9c8d-ec9d11f742e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1144 microversion: 2.1 time: 0.096279 Sep 06 21:18:00.176413 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 259/519] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:00 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1144 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:01.199011 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3aa11110-a7b6-4c3d-9d63-98d5126a7647 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:01.199605 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3aa11110-a7b6-4c3d-9d63-98d5126a7647 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:01.206597 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3aa11110-a7b6-4c3d-9d63-98d5126a7647 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:01.207082 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3aa11110-a7b6-4c3d-9d63-98d5126a7647 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:01.207511 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3aa11110-a7b6-4c3d-9d63-98d5126a7647 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:01.208210 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3aa11110-a7b6-4c3d-9d63-98d5126a7647 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:01.208682 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3aa11110-a7b6-4c3d-9d63-98d5126a7647 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:01.209112 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3aa11110-a7b6-4c3d-9d63-98d5126a7647 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:01.275016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3aa11110-a7b6-4c3d-9d63-98d5126a7647 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:01.283290 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3aa11110-a7b6-4c3d-9d63-98d5126a7647 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1192 microversion: 2.1 time: 0.088475 Sep 06 21:18:01.283856 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 261/520] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:01 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1192 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:02.308102 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4afacd95-dad2-45b7-adb0-cd7fa8689720 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:02.308865 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4afacd95-dad2-45b7-adb0-cd7fa8689720 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:02.315589 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4afacd95-dad2-45b7-adb0-cd7fa8689720 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:02.316151 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4afacd95-dad2-45b7-adb0-cd7fa8689720 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:02.316676 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4afacd95-dad2-45b7-adb0-cd7fa8689720 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:02.317475 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4afacd95-dad2-45b7-adb0-cd7fa8689720 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:02.317991 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4afacd95-dad2-45b7-adb0-cd7fa8689720 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:02.318482 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4afacd95-dad2-45b7-adb0-cd7fa8689720 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:02.391907 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4afacd95-dad2-45b7-adb0-cd7fa8689720 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:02.401239 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4afacd95-dad2-45b7-adb0-cd7fa8689720 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1210 microversion: 2.1 time: 0.097475 Sep 06 21:18:02.401862 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 260/521] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:02 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:03.426509 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5bfab288-fc20-4e85-8394-5a70c277e550 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:03.427185 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5bfab288-fc20-4e85-8394-5a70c277e550 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:03.433600 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bfab288-fc20-4e85-8394-5a70c277e550 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:03.434093 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bfab288-fc20-4e85-8394-5a70c277e550 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:03.434548 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bfab288-fc20-4e85-8394-5a70c277e550 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:03.435277 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bfab288-fc20-4e85-8394-5a70c277e550 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:03.435737 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bfab288-fc20-4e85-8394-5a70c277e550 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:03.436230 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5bfab288-fc20-4e85-8394-5a70c277e550 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:03.576287 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5bfab288-fc20-4e85-8394-5a70c277e550 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:03.586046 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5bfab288-fc20-4e85-8394-5a70c277e550 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1277 microversion: 2.1 time: 0.163957 Sep 06 21:18:03.586632 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 262/522] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:03 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:03.659395 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-d8cecb9a-6686-4181-92cb-b97811f31563 req-af427dde-d246-4c7e-b48b-97f0b0a6b42f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8d6fc21-502d-41ec-8216-29ad57153010", "tag": "8d3992ee-ded1-4b3c-8436-fe6805e12ddd"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:18:03.669967 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d8cecb9a-6686-4181-92cb-b97811f31563 req-af427dde-d246-4c7e-b48b-97f0b0a6b42f service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:03.670293 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d8cecb9a-6686-4181-92cb-b97811f31563 req-af427dde-d246-4c7e-b48b-97f0b0a6b42f service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:03.670783 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d8cecb9a-6686-4181-92cb-b97811f31563 req-af427dde-d246-4c7e-b48b-97f0b0a6b42f service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:03.683767 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-d8cecb9a-6686-4181-92cb-b97811f31563 req-af427dde-d246-4c7e-b48b-97f0b0a6b42f service nova] Creating event network-changed:8d3992ee-ded1-4b3c-8436-fe6805e12ddd for instance a8d6fc21-502d-41ec-8216-29ad57153010 on hv-cinder-74915 Sep 06 21:18:03.690053 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-d8cecb9a-6686-4181-92cb-b97811f31563 req-af427dde-d246-4c7e-b48b-97f0b0a6b42f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034413 Sep 06 21:18:03.691277 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 261/523] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:18:04.609884 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-820e15be-d79f-4e5c-b5e3-d3bf0311d09b tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:04.610476 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-820e15be-d79f-4e5c-b5e3-d3bf0311d09b tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:04.618190 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-820e15be-d79f-4e5c-b5e3-d3bf0311d09b tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:04.618930 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-820e15be-d79f-4e5c-b5e3-d3bf0311d09b tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:04.619398 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-820e15be-d79f-4e5c-b5e3-d3bf0311d09b tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:04.620871 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-820e15be-d79f-4e5c-b5e3-d3bf0311d09b tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:04.621420 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-820e15be-d79f-4e5c-b5e3-d3bf0311d09b tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:04.621898 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-820e15be-d79f-4e5c-b5e3-d3bf0311d09b tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:04.769512 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-820e15be-d79f-4e5c-b5e3-d3bf0311d09b tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:04.777963 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-820e15be-d79f-4e5c-b5e3-d3bf0311d09b tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1265 microversion: 2.1 time: 0.172026 Sep 06 21:18:04.778423 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 263/524] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:04 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:05.803971 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-00e0bb59-f733-462e-8d00-f3571edf7efd tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:05.804677 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-00e0bb59-f733-462e-8d00-f3571edf7efd tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:05.812255 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00e0bb59-f733-462e-8d00-f3571edf7efd tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:05.812749 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00e0bb59-f733-462e-8d00-f3571edf7efd tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:05.813203 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00e0bb59-f733-462e-8d00-f3571edf7efd tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:05.813901 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00e0bb59-f733-462e-8d00-f3571edf7efd tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:05.814339 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00e0bb59-f733-462e-8d00-f3571edf7efd tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:05.814757 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00e0bb59-f733-462e-8d00-f3571edf7efd tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:05.968575 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-00e0bb59-f733-462e-8d00-f3571edf7efd tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:05.979234 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-00e0bb59-f733-462e-8d00-f3571edf7efd tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1265 microversion: 2.1 time: 0.180392 Sep 06 21:18:05.979963 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 262/525] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:05 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:07.009201 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-684e29b0-f46e-4997-a5b0-09b2e8a00f8d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:07.009910 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-684e29b0-f46e-4997-a5b0-09b2e8a00f8d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:07.017053 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-684e29b0-f46e-4997-a5b0-09b2e8a00f8d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:07.017754 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-684e29b0-f46e-4997-a5b0-09b2e8a00f8d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:07.018197 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-684e29b0-f46e-4997-a5b0-09b2e8a00f8d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:07.018897 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-684e29b0-f46e-4997-a5b0-09b2e8a00f8d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:07.019454 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-684e29b0-f46e-4997-a5b0-09b2e8a00f8d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:07.019765 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-684e29b0-f46e-4997-a5b0-09b2e8a00f8d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:07.156479 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-684e29b0-f46e-4997-a5b0-09b2e8a00f8d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:07.164357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-684e29b0-f46e-4997-a5b0-09b2e8a00f8d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1265 microversion: 2.1 time: 0.159117 Sep 06 21:18:07.164950 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 264/526] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:07 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:07.553553 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3edbe10b-b148-4459-ad8b-e98655901223 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:07.554126 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3edbe10b-b148-4459-ad8b-e98655901223 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:07.560968 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3edbe10b-b148-4459-ad8b-e98655901223 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:07.561456 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3edbe10b-b148-4459-ad8b-e98655901223 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:07.561889 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3edbe10b-b148-4459-ad8b-e98655901223 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:07.562592 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3edbe10b-b148-4459-ad8b-e98655901223 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:07.563045 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3edbe10b-b148-4459-ad8b-e98655901223 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:07.563468 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3edbe10b-b148-4459-ad8b-e98655901223 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:07.704202 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-3edbe10b-b148-4459-ad8b-e98655901223 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lazy-loading 'services' on Instance uuid 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:18:07.831362 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3edbe10b-b148-4459-ad8b-e98655901223 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2/os-volume_attachments/c2eb3cbb-4c84-4bb8-9218-e00be70036e5" status: 202 len: 0 microversion: 2.1 time: 0.281884 Sep 06 21:18:07.832145 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 263/527] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Sep 6 21:18:07 2022] DELETE /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2/os-volume_attachments/c2eb3cbb-4c84-4bb8-9218-e00be70036e5 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:18:08.188378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-09f72427-bcd1-454f-b543-2e3ab0e79944 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:08.189006 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-09f72427-bcd1-454f-b543-2e3ab0e79944 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:08.191734 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:18:08.192417 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:18:08.200131 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09f72427-bcd1-454f-b543-2e3ab0e79944 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:08.200607 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09f72427-bcd1-454f-b543-2e3ab0e79944 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:08.201057 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09f72427-bcd1-454f-b543-2e3ab0e79944 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:08.201758 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09f72427-bcd1-454f-b543-2e3ab0e79944 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:08.202201 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09f72427-bcd1-454f-b543-2e3ab0e79944 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:08.202619 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09f72427-bcd1-454f-b543-2e3ab0e79944 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:08.344844 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-09f72427-bcd1-454f-b543-2e3ab0e79944 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:08.353356 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-09f72427-bcd1-454f-b543-2e3ab0e79944 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1265 microversion: 2.1 time: 0.169462 Sep 06 21:18:08.354145 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 265/528] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:08 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:09.373948 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:18:09.378988 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7b753263-28b4-40f1-8587-f77d74b442bc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:09.379668 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7b753263-28b4-40f1-8587-f77d74b442bc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:09.387371 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b753263-28b4-40f1-8587-f77d74b442bc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:09.387834 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b753263-28b4-40f1-8587-f77d74b442bc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:09.388282 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b753263-28b4-40f1-8587-f77d74b442bc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:09.389028 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b753263-28b4-40f1-8587-f77d74b442bc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:09.390523 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b753263-28b4-40f1-8587-f77d74b442bc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:09.390984 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b753263-28b4-40f1-8587-f77d74b442bc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:09.639364 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7b753263-28b4-40f1-8587-f77d74b442bc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:09.647865 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7b753263-28b4-40f1-8587-f77d74b442bc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1265 microversion: 2.1 time: 0.274922 Sep 06 21:18:09.648441 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 264/529] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:09 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1265 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:10.042509 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-518c2593-8c8e-4b4f-b15d-aaa48afae5ea tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:10.043817 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-518c2593-8c8e-4b4f-b15d-aaa48afae5ea tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:10.054964 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-518c2593-8c8e-4b4f-b15d-aaa48afae5ea tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:10.055639 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-518c2593-8c8e-4b4f-b15d-aaa48afae5ea tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:10.056190 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-518c2593-8c8e-4b4f-b15d-aaa48afae5ea tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:10.057154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-518c2593-8c8e-4b4f-b15d-aaa48afae5ea tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:10.057890 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-518c2593-8c8e-4b4f-b15d-aaa48afae5ea tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:10.058338 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-518c2593-8c8e-4b4f-b15d-aaa48afae5ea tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:10.092379 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-518c2593-8c8e-4b4f-b15d-aaa48afae5ea tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 21:18:10.179378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-518c2593-8c8e-4b4f-b15d-aaa48afae5ea tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2" status: 204 len: 0 microversion: 2.1 time: 0.140663 Sep 06 21:18:10.179974 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 266/530] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Sep 6 21:18:10 2022] DELETE /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 21:18:10.188447 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4ad924b4-56c6-442c-be7d-e3b3d5ec7843 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:10.189098 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4ad924b4-56c6-442c-be7d-e3b3d5ec7843 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:10.195587 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ad924b4-56c6-442c-be7d-e3b3d5ec7843 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:10.196067 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ad924b4-56c6-442c-be7d-e3b3d5ec7843 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:10.196502 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ad924b4-56c6-442c-be7d-e3b3d5ec7843 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:10.197245 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ad924b4-56c6-442c-be7d-e3b3d5ec7843 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:10.197729 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ad924b4-56c6-442c-be7d-e3b3d5ec7843 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:10.198334 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ad924b4-56c6-442c-be7d-e3b3d5ec7843 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:10.338707 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4ad924b4-56c6-442c-be7d-e3b3d5ec7843 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:10.346511 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4ad924b4-56c6-442c-be7d-e3b3d5ec7843 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2" status: 200 len: 1513 microversion: 2.1 time: 0.162172 Sep 06 21:18:10.347082 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 265/531] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:10 2022] GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:10.672639 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2711d02b-5ec3-40c6-b9d3-6fa40ea8ff83 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:10.673915 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2711d02b-5ec3-40c6-b9d3-6fa40ea8ff83 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:10.680192 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2711d02b-5ec3-40c6-b9d3-6fa40ea8ff83 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:10.680705 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2711d02b-5ec3-40c6-b9d3-6fa40ea8ff83 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:10.681185 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2711d02b-5ec3-40c6-b9d3-6fa40ea8ff83 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:10.681891 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2711d02b-5ec3-40c6-b9d3-6fa40ea8ff83 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:10.682326 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2711d02b-5ec3-40c6-b9d3-6fa40ea8ff83 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:10.682740 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2711d02b-5ec3-40c6-b9d3-6fa40ea8ff83 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:10.821218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2711d02b-5ec3-40c6-b9d3-6fa40ea8ff83 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:10.829061 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2711d02b-5ec3-40c6-b9d3-6fa40ea8ff83 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1265 microversion: 2.1 time: 0.160767 Sep 06 21:18:10.829632 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 267/532] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:10 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:11.369564 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-87fda23b-17a5-43ef-8383-f86aedeb8f90 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:11.370325 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-87fda23b-17a5-43ef-8383-f86aedeb8f90 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:11.377093 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87fda23b-17a5-43ef-8383-f86aedeb8f90 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:11.377687 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87fda23b-17a5-43ef-8383-f86aedeb8f90 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:11.378241 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87fda23b-17a5-43ef-8383-f86aedeb8f90 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:11.379062 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87fda23b-17a5-43ef-8383-f86aedeb8f90 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:11.379717 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87fda23b-17a5-43ef-8383-f86aedeb8f90 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:11.380189 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87fda23b-17a5-43ef-8383-f86aedeb8f90 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:11.517628 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-87fda23b-17a5-43ef-8383-f86aedeb8f90 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:11.525677 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-87fda23b-17a5-43ef-8383-f86aedeb8f90 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2" status: 200 len: 1513 microversion: 2.1 time: 0.160103 Sep 06 21:18:11.526368 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 266/533] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:11 2022] GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:11.853001 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b54e56c1-bd94-4067-b74e-a3df1b141982 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:11.853638 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b54e56c1-bd94-4067-b74e-a3df1b141982 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:11.860383 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b54e56c1-bd94-4067-b74e-a3df1b141982 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:11.861005 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b54e56c1-bd94-4067-b74e-a3df1b141982 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:11.861452 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b54e56c1-bd94-4067-b74e-a3df1b141982 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:11.862146 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b54e56c1-bd94-4067-b74e-a3df1b141982 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:11.862589 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b54e56c1-bd94-4067-b74e-a3df1b141982 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:11.863003 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b54e56c1-bd94-4067-b74e-a3df1b141982 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:12.000610 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b54e56c1-bd94-4067-b74e-a3df1b141982 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:12.009396 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b54e56c1-bd94-4067-b74e-a3df1b141982 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1265 microversion: 2.1 time: 0.160263 Sep 06 21:18:12.010155 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 268/534] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:11 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:12.550362 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6512bd73-6f30-48ab-a9ff-cc9d37a035a5 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:12.551152 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6512bd73-6f30-48ab-a9ff-cc9d37a035a5 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:12.570038 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6512bd73-6f30-48ab-a9ff-cc9d37a035a5 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:12.570642 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6512bd73-6f30-48ab-a9ff-cc9d37a035a5 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:12.571126 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6512bd73-6f30-48ab-a9ff-cc9d37a035a5 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:12.572260 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6512bd73-6f30-48ab-a9ff-cc9d37a035a5 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:12.573084 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6512bd73-6f30-48ab-a9ff-cc9d37a035a5 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:12.573515 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6512bd73-6f30-48ab-a9ff-cc9d37a035a5 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:12.722964 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6512bd73-6f30-48ab-a9ff-cc9d37a035a5 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:12.731234 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6512bd73-6f30-48ab-a9ff-cc9d37a035a5 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2" status: 200 len: 1513 microversion: 2.1 time: 0.185704 Sep 06 21:18:12.731779 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 267/535] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:12 2022] GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 => generated 1513 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:13.033141 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0437684e-0f26-4262-8aec-c978ad0c7dfc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:13.033773 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0437684e-0f26-4262-8aec-c978ad0c7dfc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:13.040774 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0437684e-0f26-4262-8aec-c978ad0c7dfc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:13.041248 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0437684e-0f26-4262-8aec-c978ad0c7dfc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:13.041689 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0437684e-0f26-4262-8aec-c978ad0c7dfc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:13.042421 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0437684e-0f26-4262-8aec-c978ad0c7dfc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:13.042873 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0437684e-0f26-4262-8aec-c978ad0c7dfc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:13.043301 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0437684e-0f26-4262-8aec-c978ad0c7dfc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:13.192850 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0437684e-0f26-4262-8aec-c978ad0c7dfc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:13.201393 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0437684e-0f26-4262-8aec-c978ad0c7dfc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1265 microversion: 2.1 time: 0.172140 Sep 06 21:18:13.201975 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 269/536] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:13 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:13.755418 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0466cf28-e49e-4529-84e2-af81e9aa4db3 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:13.756055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0466cf28-e49e-4529-84e2-af81e9aa4db3 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:13.763551 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0466cf28-e49e-4529-84e2-af81e9aa4db3 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:13.764034 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0466cf28-e49e-4529-84e2-af81e9aa4db3 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:13.764449 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0466cf28-e49e-4529-84e2-af81e9aa4db3 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:13.765214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0466cf28-e49e-4529-84e2-af81e9aa4db3 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:13.765694 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0466cf28-e49e-4529-84e2-af81e9aa4db3 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:13.766116 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0466cf28-e49e-4529-84e2-af81e9aa4db3 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:13.908899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0466cf28-e49e-4529-84e2-af81e9aa4db3 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:13.917813 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0466cf28-e49e-4529-84e2-af81e9aa4db3 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2" status: 200 len: 1513 microversion: 2.1 time: 0.166170 Sep 06 21:18:13.918599 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 268/537] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:13 2022] GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:14.224294 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-95f92927-953b-44e2-821b-67b22aabf823 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:14.224902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-95f92927-953b-44e2-821b-67b22aabf823 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:14.231751 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95f92927-953b-44e2-821b-67b22aabf823 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:14.232393 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95f92927-953b-44e2-821b-67b22aabf823 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:14.232859 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95f92927-953b-44e2-821b-67b22aabf823 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:14.233546 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95f92927-953b-44e2-821b-67b22aabf823 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:14.233988 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95f92927-953b-44e2-821b-67b22aabf823 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:14.234405 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95f92927-953b-44e2-821b-67b22aabf823 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:14.379458 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-95f92927-953b-44e2-821b-67b22aabf823 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:14.389582 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-95f92927-953b-44e2-821b-67b22aabf823 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1265 microversion: 2.1 time: 0.169331 Sep 06 21:18:14.390150 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 270/538] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:14 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:14.938328 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-64911772-f2eb-4de4-b54c-c8f59621af85 req-35548c89-9819-489c-beff-17a9b6be9db4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8213fe3f-e8c0-4919-b1d8-02f6c049b0d2", "name": "network-vif-deleted", "tag": "1795cb49-18af-42b5-8214-76d1f8210b66"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:18:14.943407 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-71607d8b-4d69-44a7-b626-7dba176ada2b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:14.944329 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-71607d8b-4d69-44a7-b626-7dba176ada2b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:14.948464 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-64911772-f2eb-4de4-b54c-c8f59621af85 req-35548c89-9819-489c-beff-17a9b6be9db4 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:14.949002 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-64911772-f2eb-4de4-b54c-c8f59621af85 req-35548c89-9819-489c-beff-17a9b6be9db4 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:14.949434 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-64911772-f2eb-4de4-b54c-c8f59621af85 req-35548c89-9819-489c-beff-17a9b6be9db4 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:14.951097 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71607d8b-4d69-44a7-b626-7dba176ada2b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:14.951672 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71607d8b-4d69-44a7-b626-7dba176ada2b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:14.952203 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71607d8b-4d69-44a7-b626-7dba176ada2b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:14.953411 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71607d8b-4d69-44a7-b626-7dba176ada2b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:14.953967 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71607d8b-4d69-44a7-b626-7dba176ada2b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:14.954638 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71607d8b-4d69-44a7-b626-7dba176ada2b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:14.960969 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-64911772-f2eb-4de4-b54c-c8f59621af85 req-35548c89-9819-489c-beff-17a9b6be9db4 service nova] Creating event network-vif-deleted:1795cb49-18af-42b5-8214-76d1f8210b66 for instance 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 on hv-cinder-74915 Sep 06 21:18:14.967173 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-64911772-f2eb-4de4-b54c-c8f59621af85 req-35548c89-9819-489c-beff-17a9b6be9db4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032495 Sep 06 21:18:14.968030 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 269/539] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 21:18:15.027191 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-71607d8b-4d69-44a7-b626-7dba176ada2b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:15.035600 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-71607d8b-4d69-44a7-b626-7dba176ada2b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2" status: 200 len: 1471 microversion: 2.1 time: 0.096521 Sep 06 21:18:15.036226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 271/540] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:14 2022] GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 => generated 1471 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:18:15.194473 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-45281b33-15af-400f-bab7-a497a5b4d6c2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:15.195101 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-45281b33-15af-400f-bab7-a497a5b4d6c2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:15.202349 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45281b33-15af-400f-bab7-a497a5b4d6c2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:15.202862 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45281b33-15af-400f-bab7-a497a5b4d6c2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:15.203512 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45281b33-15af-400f-bab7-a497a5b4d6c2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:15.204259 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45281b33-15af-400f-bab7-a497a5b4d6c2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:15.204800 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45281b33-15af-400f-bab7-a497a5b4d6c2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:15.205330 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45281b33-15af-400f-bab7-a497a5b4d6c2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:15.233095 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-45281b33-15af-400f-bab7-a497a5b4d6c2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650/ips" status: 200 len: 151 microversion: 2.20 time: 0.043154 Sep 06 21:18:15.233672 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 270/541] 10.222.0.79 () {60 vars in 1289 bytes} [Tue Sep 6 21:18:15 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 21:18:15.413112 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-31f52d04-b2c8-419d-a184-b208d476e40d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:15.413844 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-31f52d04-b2c8-419d-a184-b208d476e40d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:15.421365 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31f52d04-b2c8-419d-a184-b208d476e40d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:15.421935 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31f52d04-b2c8-419d-a184-b208d476e40d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:15.422300 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31f52d04-b2c8-419d-a184-b208d476e40d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:15.423540 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31f52d04-b2c8-419d-a184-b208d476e40d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:15.424008 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31f52d04-b2c8-419d-a184-b208d476e40d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:15.424427 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-31f52d04-b2c8-419d-a184-b208d476e40d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:15.586769 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-31f52d04-b2c8-419d-a184-b208d476e40d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:15.596602 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-31f52d04-b2c8-419d-a184-b208d476e40d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1265 microversion: 2.1 time: 0.187354 Sep 06 21:18:15.597481 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 272/542] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:15 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:15.924910 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9a7fb3ed-bd5e-4927-a1a7-7271ecf6fa94 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-563718092", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1733900156", "security_groups": [{"name": "tempest-secgroup-smoke-1787253530"}], "networks": [{"uuid": "898c1f4b-e1f5-4ef7-ad08-8c66032e7f40"}], "block_device_mapping_v2": [{"uuid": "de13a59a-8da3-4260-8c39-a4c85829e7c2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:18:16.042629 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-9a7fb3ed-bd5e-4927-a1a7-7271ecf6fa94 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] validate_networks() for [('898c1f4b-e1f5-4ef7-ad08-8c66032e7f40', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 21:18:16.062509 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4786499e-2e0f-4299-bac2-2d3d1bfbbb79 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:16.063538 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4786499e-2e0f-4299-bac2-2d3d1bfbbb79 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:16.070045 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4786499e-2e0f-4299-bac2-2d3d1bfbbb79 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:16.071188 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4786499e-2e0f-4299-bac2-2d3d1bfbbb79 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:16.071774 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4786499e-2e0f-4299-bac2-2d3d1bfbbb79 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:16.072684 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4786499e-2e0f-4299-bac2-2d3d1bfbbb79 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:16.073128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4786499e-2e0f-4299-bac2-2d3d1bfbbb79 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:16.073822 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4786499e-2e0f-4299-bac2-2d3d1bfbbb79 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:16.090889 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-4786499e-2e0f-4299-bac2-2d3d1bfbbb79 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] HTTP exception thrown: Instance 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 could not be found. Sep 06 21:18:16.092550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4786499e-2e0f-4299-bac2-2d3d1bfbbb79 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Request method failure captured: Sep 06 21:18:16.092550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 HTTP/1.1 Sep 06 21:18:16.092550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:18:16.092550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:18:16.092550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:18:16.092550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:18:16.092550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:18:16.092550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:18:16.092550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:18:16.092550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:18:16.092550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7igQZvrWC8vVHP9plwV4Wm4s82bH3zhAOY2v51BD4VZyGweaT-ObbPB5XzgueD40khRimnscszz_hK5SMfyQUSGg8_3znU_4GDuQidHPsYqRWCklBLT3FT76tagBD-86PwMNxoNtEy12E9EEDgKDo3hctXFPUR5mcSI2UOXFjy3JBM Sep 06 21:18:16.092550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:18:16.092550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:18:16.092550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:18:16.092550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:18:16.092550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:18:16.092550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:18:16.092550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: 3c0901a228de4c59bc0e999f55bc1e08 Sep 06 21:18:16.092550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1243964682 Sep 06 21:18:16.092550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:18:16.092550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:18:16.094684 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3c0901a228de4c59bc0e999f55bc1e08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3c0901a228de4c59bc0e999f55bc1e08", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3c0901a228de4c59bc0e999f55bc1e08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3c0901a228de4c59bc0e999f55bc1e08"}]}] Sep 06 21:18:16.094684 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-VolumesSnapshotTestJSON-1243964682 Sep 06 21:18:16.094684 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 3c0901a228de4c59bc0e999f55bc1e08 Sep 06 21:18:16.094684 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1243964682 Sep 06 21:18:16.094684 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-VolumesSnapshotTestJSON-1243964682-project Sep 06 21:18:16.094684 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:18:16.094684 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:18:16.094684 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: 71e0c39501bf48c2a63257a4cf75def1 Sep 06 21:18:16.094684 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-VolumesSnapshotTestJSON-1243964682-project Sep 06 21:18:16.094684 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: > Sep 06 21:18:16.094684 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Instance 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 could not be found. Sep 06 21:18:16.094684 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'id': '8213fe3f-e8c0-4919-b1d8-02f6c049b0d2'} Sep 06 21:18:16.096261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:18:16.096261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:18:16.096261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:18:16.096261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:18:16.096261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:18:16.096261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:18:16.096261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:18:16.096261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:18:16.096261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:18:16.096261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:18:16.096261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 could not be found. Sep 06 21:18:16.096261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:18:16.096261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:18:16.096261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:18:16.096261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:18:16.096261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:18:16.096261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:18:16.096261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:18:16.096261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:18:16.096261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:18:16.098859 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:18:16.098859 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:18:16.098859 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:18:16.098859 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:18:16.098859 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:18:16.098859 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:18:16.098859 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:18:16.098859 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 could not be found. Sep 06 21:18:16.098859 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:18:16.098859 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:18:16.098859 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:18:16.098859 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:18:16.098859 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:18:16.098859 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:18:16.098859 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:18:16.098859 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:18:16.098859 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 could not be found. Sep 06 21:18:16.098859 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:18:16.102639 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4786499e-2e0f-4299-bac2-2d3d1bfbbb79 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Returning 404 to user: Instance 8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:18:16.104167 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4786499e-2e0f-4299-bac2-2d3d1bfbbb79 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2" status: 404 len: 111 microversion: 2.1 time: 0.047433 Sep 06 21:18:16.105412 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 273/543] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:16 2022] GET /compute/v2.1/servers/8213fe3f-e8c0-4919-b1d8-02f6c049b0d2 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:18:16.520149 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-9a7fb3ed-bd5e-4927-a1a7-7271ecf6fa94 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 21:18:16.520685 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-9a7fb3ed-bd5e-4927-a1a7-7271ecf6fa94 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 21:18:16.521232 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-9a7fb3ed-bd5e-4927-a1a7-7271ecf6fa94 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 21:18:16.521637 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-9a7fb3ed-bd5e-4927-a1a7-7271ecf6fa94 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 21:18:16.522061 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-9a7fb3ed-bd5e-4927-a1a7-7271ecf6fa94 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 21:18:16.541535 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a7fb3ed-bd5e-4927-a1a7-7271ecf6fa94 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:16.542051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a7fb3ed-bd5e-4927-a1a7-7271ecf6fa94 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:16.542483 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a7fb3ed-bd5e-4927-a1a7-7271ecf6fa94 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:16.543247 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a7fb3ed-bd5e-4927-a1a7-7271ecf6fa94 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:16.543692 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a7fb3ed-bd5e-4927-a1a7-7271ecf6fa94 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:16.544117 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a7fb3ed-bd5e-4927-a1a7-7271ecf6fa94 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:16.571513 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-9a7fb3ed-bd5e-4927-a1a7-7271ecf6fa94 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Getting quotas for project fd90c9c3a5554874b6b1d2e5d32d11f9. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:18:16.578243 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-9a7fb3ed-bd5e-4927-a1a7-7271ecf6fa94 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Getting quotas for user b9d62ee769bb4097b02703cca87ee6f4 and project fd90c9c3a5554874b6b1d2e5d32d11f9. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:18:16.620535 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1bcc43ad-4986-494e-bf1d-5c5c61d677fc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:16.622955 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1bcc43ad-4986-494e-bf1d-5c5c61d677fc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:16.632891 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bcc43ad-4986-494e-bf1d-5c5c61d677fc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:16.633585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bcc43ad-4986-494e-bf1d-5c5c61d677fc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:16.634289 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bcc43ad-4986-494e-bf1d-5c5c61d677fc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:16.635338 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bcc43ad-4986-494e-bf1d-5c5c61d677fc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:16.636074 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bcc43ad-4986-494e-bf1d-5c5c61d677fc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:16.636753 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bcc43ad-4986-494e-bf1d-5c5c61d677fc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:16.676914 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9a7fb3ed-bd5e-4927-a1a7-7271ecf6fa94 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 21:18:16.679900 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9a7fb3ed-bd5e-4927-a1a7-7271ecf6fa94 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='de13a59a-8da3-4260-8c39-a4c85829e7c2',volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 21:18:16.817540 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1bcc43ad-4986-494e-bf1d-5c5c61d677fc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:16.826384 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1bcc43ad-4986-494e-bf1d-5c5c61d677fc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1265 microversion: 2.1 time: 0.210479 Sep 06 21:18:16.826967 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 274/544] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:16 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:18:16.863294 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9a7fb3ed-bd5e-4927-a1a7-7271ecf6fa94 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.942695 Sep 06 21:18:16.864102 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 271/545] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Sep 6 21:18:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 21:18:16.876152 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3575385c-0027-4258-ac48-d2fe6f96bc96 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:16.877007 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3575385c-0027-4258-ac48-d2fe6f96bc96 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:16.940549 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3575385c-0027-4258-ac48-d2fe6f96bc96 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:16.949009 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3575385c-0027-4258-ac48-d2fe6f96bc96 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1088 microversion: 2.1 time: 0.076514 Sep 06 21:18:16.949587 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 275/546] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:16 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1088 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:17.189263 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ebe5aa79-88d0-4c20-8339-515d6ba95a35 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:18:17.190536 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ebe5aa79-88d0-4c20-8339-515d6ba95a35 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:17.198743 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ebe5aa79-88d0-4c20-8339-515d6ba95a35 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:17.199454 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ebe5aa79-88d0-4c20-8339-515d6ba95a35 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:17.200179 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ebe5aa79-88d0-4c20-8339-515d6ba95a35 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:17.215655 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ebe5aa79-88d0-4c20-8339-515d6ba95a35 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:17.217753 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ebe5aa79-88d0-4c20-8339-515d6ba95a35 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:17.219178 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ebe5aa79-88d0-4c20-8339-515d6ba95a35 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:17.250487 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-ebe5aa79-88d0-4c20-8339-515d6ba95a35 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lazy-loading 'flavor' on Instance uuid 8fea1aa0-032e-454d-9358-98a81cd5d650 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:18:17.486446 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ebe5aa79-88d0-4c20-8339-515d6ba95a35 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "POST /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650/action" status: 202 len: 0 microversion: 2.20 time: 0.301226 Sep 06 21:18:17.487021 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 272/547] 10.222.0.79 () {62 vars in 1319 bytes} [Tue Sep 6 21:18:17 2022] POST /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 06 21:18:17.495845 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-62eeb166-b8bc-43ed-9126-eec47106eaeb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:17.496531 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-62eeb166-b8bc-43ed-9126-eec47106eaeb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:17.503267 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62eeb166-b8bc-43ed-9126-eec47106eaeb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:17.503760 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62eeb166-b8bc-43ed-9126-eec47106eaeb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:17.504213 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62eeb166-b8bc-43ed-9126-eec47106eaeb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:17.504934 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62eeb166-b8bc-43ed-9126-eec47106eaeb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:17.505556 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62eeb166-b8bc-43ed-9126-eec47106eaeb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:17.506009 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-62eeb166-b8bc-43ed-9126-eec47106eaeb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:17.510871 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:18:17.656695 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-62eeb166-b8bc-43ed-9126-eec47106eaeb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:17.665658 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-62eeb166-b8bc-43ed-9126-eec47106eaeb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:17.667716 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-62eeb166-b8bc-43ed-9126-eec47106eaeb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:17.668562 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-62eeb166-b8bc-43ed-9126-eec47106eaeb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1723 microversion: 2.20 time: 0.176900 Sep 06 21:18:17.669159 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 276/548] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:17 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 21:18:17.853790 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7826017f-06ee-42ff-aea2-7dc581a5a044 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:17.854609 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7826017f-06ee-42ff-aea2-7dc581a5a044 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:17.861614 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7826017f-06ee-42ff-aea2-7dc581a5a044 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:17.862123 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7826017f-06ee-42ff-aea2-7dc581a5a044 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:17.862557 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7826017f-06ee-42ff-aea2-7dc581a5a044 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:17.863262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7826017f-06ee-42ff-aea2-7dc581a5a044 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:17.863720 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7826017f-06ee-42ff-aea2-7dc581a5a044 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:17.864143 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7826017f-06ee-42ff-aea2-7dc581a5a044 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:17.971860 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7a2bab58-2d03-4c8a-8543-b70f28117864 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:17.972475 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7a2bab58-2d03-4c8a-8543-b70f28117864 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:17.978869 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a2bab58-2d03-4c8a-8543-b70f28117864 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:17.979343 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a2bab58-2d03-4c8a-8543-b70f28117864 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:17.979811 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a2bab58-2d03-4c8a-8543-b70f28117864 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:17.980520 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a2bab58-2d03-4c8a-8543-b70f28117864 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:17.981019 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a2bab58-2d03-4c8a-8543-b70f28117864 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:17.981437 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a2bab58-2d03-4c8a-8543-b70f28117864 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:18.011128 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7826017f-06ee-42ff-aea2-7dc581a5a044 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:18.019825 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7826017f-06ee-42ff-aea2-7dc581a5a044 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1265 microversion: 2.1 time: 0.171087 Sep 06 21:18:18.020406 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 273/549] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:17 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:18.044448 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7a2bab58-2d03-4c8a-8543-b70f28117864 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:18.052809 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7a2bab58-2d03-4c8a-8543-b70f28117864 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1130 microversion: 2.1 time: 0.084974 Sep 06 21:18:18.053344 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 277/550] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:17 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1130 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:18.696457 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3ace0609-b6bc-483e-b1b9-3aa3d26a6a02 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:18.697061 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3ace0609-b6bc-483e-b1b9-3aa3d26a6a02 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:18.705154 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ace0609-b6bc-483e-b1b9-3aa3d26a6a02 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:18.705662 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ace0609-b6bc-483e-b1b9-3aa3d26a6a02 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:18.706107 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ace0609-b6bc-483e-b1b9-3aa3d26a6a02 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:18.706815 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ace0609-b6bc-483e-b1b9-3aa3d26a6a02 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:18.707266 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ace0609-b6bc-483e-b1b9-3aa3d26a6a02 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:18.707690 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ace0609-b6bc-483e-b1b9-3aa3d26a6a02 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:18.846970 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3ace0609-b6bc-483e-b1b9-3aa3d26a6a02 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:18.855595 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3ace0609-b6bc-483e-b1b9-3aa3d26a6a02 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:18.857059 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3ace0609-b6bc-483e-b1b9-3aa3d26a6a02 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:18.858256 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3ace0609-b6bc-483e-b1b9-3aa3d26a6a02 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1723 microversion: 2.20 time: 0.166184 Sep 06 21:18:18.858816 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 274/551] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:18 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:18:19.044370 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-175deb6f-bb42-4f57-95fe-8962024e34c5 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:19.044988 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-175deb6f-bb42-4f57-95fe-8962024e34c5 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:19.052644 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-175deb6f-bb42-4f57-95fe-8962024e34c5 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:19.053153 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-175deb6f-bb42-4f57-95fe-8962024e34c5 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:19.053585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-175deb6f-bb42-4f57-95fe-8962024e34c5 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:19.054290 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-175deb6f-bb42-4f57-95fe-8962024e34c5 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:19.054739 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-175deb6f-bb42-4f57-95fe-8962024e34c5 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:19.055161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-175deb6f-bb42-4f57-95fe-8962024e34c5 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:19.075775 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-43dc3506-0e4e-42f7-b7b7-f68b07b70084 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:19.076393 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-43dc3506-0e4e-42f7-b7b7-f68b07b70084 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:19.085150 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43dc3506-0e4e-42f7-b7b7-f68b07b70084 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:19.085954 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43dc3506-0e4e-42f7-b7b7-f68b07b70084 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:19.086428 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43dc3506-0e4e-42f7-b7b7-f68b07b70084 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:19.086428 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43dc3506-0e4e-42f7-b7b7-f68b07b70084 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:19.088695 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43dc3506-0e4e-42f7-b7b7-f68b07b70084 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:19.089788 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43dc3506-0e4e-42f7-b7b7-f68b07b70084 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:19.096583 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:18:19.167153 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-43dc3506-0e4e-42f7-b7b7-f68b07b70084 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:19.176753 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-43dc3506-0e4e-42f7-b7b7-f68b07b70084 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1130 microversion: 2.1 time: 0.104876 Sep 06 21:18:19.177448 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 275/552] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:19 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1130 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:19.204474 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-175deb6f-bb42-4f57-95fe-8962024e34c5 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:19.212684 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-175deb6f-bb42-4f57-95fe-8962024e34c5 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1265 microversion: 2.1 time: 0.173163 Sep 06 21:18:19.213396 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 278/553] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:19 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:19.884962 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-298c811e-92a9-437c-abf0-c9cf0de9b1a2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:19.885533 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-298c811e-92a9-437c-abf0-c9cf0de9b1a2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:19.892513 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-298c811e-92a9-437c-abf0-c9cf0de9b1a2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:19.893035 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-298c811e-92a9-437c-abf0-c9cf0de9b1a2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:19.893463 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-298c811e-92a9-437c-abf0-c9cf0de9b1a2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:19.894154 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-298c811e-92a9-437c-abf0-c9cf0de9b1a2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:19.894599 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-298c811e-92a9-437c-abf0-c9cf0de9b1a2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:19.895017 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-298c811e-92a9-437c-abf0-c9cf0de9b1a2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:20.029888 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-298c811e-92a9-437c-abf0-c9cf0de9b1a2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:20.038437 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-298c811e-92a9-437c-abf0-c9cf0de9b1a2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:20.039863 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-298c811e-92a9-437c-abf0-c9cf0de9b1a2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:20.041050 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-298c811e-92a9-437c-abf0-c9cf0de9b1a2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1723 microversion: 2.20 time: 0.160317 Sep 06 21:18:20.041586 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 276/554] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:19 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:18:20.201640 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e6f72274-fc35-40d8-90cf-41268e9978be tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:20.202698 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e6f72274-fc35-40d8-90cf-41268e9978be tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:20.209307 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6f72274-fc35-40d8-90cf-41268e9978be tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:20.209782 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6f72274-fc35-40d8-90cf-41268e9978be tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:20.210206 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6f72274-fc35-40d8-90cf-41268e9978be tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:20.210877 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6f72274-fc35-40d8-90cf-41268e9978be tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:20.211315 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6f72274-fc35-40d8-90cf-41268e9978be tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:20.211729 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6f72274-fc35-40d8-90cf-41268e9978be tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:20.235664 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e1227a15-93ec-4453-a54c-2d28c9bb60e5 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:20.236257 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e1227a15-93ec-4453-a54c-2d28c9bb60e5 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:20.242598 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1227a15-93ec-4453-a54c-2d28c9bb60e5 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:20.243078 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1227a15-93ec-4453-a54c-2d28c9bb60e5 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:20.243510 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1227a15-93ec-4453-a54c-2d28c9bb60e5 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:20.244202 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1227a15-93ec-4453-a54c-2d28c9bb60e5 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:20.244785 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1227a15-93ec-4453-a54c-2d28c9bb60e5 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:20.245193 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1227a15-93ec-4453-a54c-2d28c9bb60e5 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:20.273227 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e6f72274-fc35-40d8-90cf-41268e9978be tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:20.281768 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e6f72274-fc35-40d8-90cf-41268e9978be tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1130 microversion: 2.1 time: 0.084329 Sep 06 21:18:20.282600 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 279/555] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:20 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1130 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:20.377188 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e1227a15-93ec-4453-a54c-2d28c9bb60e5 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:20.385214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e1227a15-93ec-4453-a54c-2d28c9bb60e5 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1265 microversion: 2.1 time: 0.153520 Sep 06 21:18:20.385748 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 277/556] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:20 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:21.067187 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dac83fda-96be-44a2-af57-8046880561d3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:21.067790 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dac83fda-96be-44a2-af57-8046880561d3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:21.074126 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dac83fda-96be-44a2-af57-8046880561d3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:21.074635 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dac83fda-96be-44a2-af57-8046880561d3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:21.075112 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dac83fda-96be-44a2-af57-8046880561d3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:21.075808 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dac83fda-96be-44a2-af57-8046880561d3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:21.076255 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dac83fda-96be-44a2-af57-8046880561d3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:21.076689 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dac83fda-96be-44a2-af57-8046880561d3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:21.208896 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-dac83fda-96be-44a2-af57-8046880561d3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:21.218191 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-dac83fda-96be-44a2-af57-8046880561d3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:21.219623 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-dac83fda-96be-44a2-af57-8046880561d3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:21.220814 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dac83fda-96be-44a2-af57-8046880561d3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1723 microversion: 2.20 time: 0.157743 Sep 06 21:18:21.221444 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 280/557] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:21 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:18:21.305459 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8e225b8a-7d50-46b0-bf00-9f8fd1aaad06 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:21.306029 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8e225b8a-7d50-46b0-bf00-9f8fd1aaad06 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:21.313000 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e225b8a-7d50-46b0-bf00-9f8fd1aaad06 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:21.313481 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e225b8a-7d50-46b0-bf00-9f8fd1aaad06 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:21.313921 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e225b8a-7d50-46b0-bf00-9f8fd1aaad06 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:21.314619 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e225b8a-7d50-46b0-bf00-9f8fd1aaad06 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:21.315069 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e225b8a-7d50-46b0-bf00-9f8fd1aaad06 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:21.315492 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e225b8a-7d50-46b0-bf00-9f8fd1aaad06 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:21.377981 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8e225b8a-7d50-46b0-bf00-9f8fd1aaad06 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:21.386406 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8e225b8a-7d50-46b0-bf00-9f8fd1aaad06 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1186 microversion: 2.1 time: 0.084665 Sep 06 21:18:21.386966 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 278/558] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:21 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1186 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:21.407594 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8c1a3120-1277-47eb-bc33-ccc428d30b76 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:21.408197 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8c1a3120-1277-47eb-bc33-ccc428d30b76 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:21.414712 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c1a3120-1277-47eb-bc33-ccc428d30b76 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:21.415190 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c1a3120-1277-47eb-bc33-ccc428d30b76 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:21.415622 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c1a3120-1277-47eb-bc33-ccc428d30b76 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:21.416315 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c1a3120-1277-47eb-bc33-ccc428d30b76 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:21.416766 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c1a3120-1277-47eb-bc33-ccc428d30b76 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:21.417270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c1a3120-1277-47eb-bc33-ccc428d30b76 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:21.551152 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8c1a3120-1277-47eb-bc33-ccc428d30b76 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:21.559179 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8c1a3120-1277-47eb-bc33-ccc428d30b76 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1265 microversion: 2.1 time: 0.155554 Sep 06 21:18:21.559744 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 281/559] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:21 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:21.968203 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-9e7fd1d5-d222-474d-be0d-4cf52f5d8af1 req-d08573ae-3e24-4414-b4ca-b0dfdd51de4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8d6fc21-502d-41ec-8216-29ad57153010", "name": "network-vif-plugged", "status": "completed", "tag": "8d3992ee-ded1-4b3c-8436-fe6805e12ddd"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:18:21.978611 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9e7fd1d5-d222-474d-be0d-4cf52f5d8af1 req-d08573ae-3e24-4414-b4ca-b0dfdd51de4c service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:21.979077 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9e7fd1d5-d222-474d-be0d-4cf52f5d8af1 req-d08573ae-3e24-4414-b4ca-b0dfdd51de4c service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:21.979497 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9e7fd1d5-d222-474d-be0d-4cf52f5d8af1 req-d08573ae-3e24-4414-b4ca-b0dfdd51de4c service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:21.990914 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-9e7fd1d5-d222-474d-be0d-4cf52f5d8af1 req-d08573ae-3e24-4414-b4ca-b0dfdd51de4c service nova] Creating event network-vif-plugged:8d3992ee-ded1-4b3c-8436-fe6805e12ddd for instance a8d6fc21-502d-41ec-8216-29ad57153010 on hv-cinder-74915 Sep 06 21:18:21.996167 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-9e7fd1d5-d222-474d-be0d-4cf52f5d8af1 req-d08573ae-3e24-4414-b4ca-b0dfdd51de4c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031696 Sep 06 21:18:21.996782 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 279/560] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:18:22.246281 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1d29d582-dec7-4534-9bf3-aa1769f4a550 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:22.246924 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1d29d582-dec7-4534-9bf3-aa1769f4a550 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:22.253907 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d29d582-dec7-4534-9bf3-aa1769f4a550 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:22.254316 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d29d582-dec7-4534-9bf3-aa1769f4a550 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:22.254829 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d29d582-dec7-4534-9bf3-aa1769f4a550 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:22.255748 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d29d582-dec7-4534-9bf3-aa1769f4a550 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:22.256197 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d29d582-dec7-4534-9bf3-aa1769f4a550 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:22.256611 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d29d582-dec7-4534-9bf3-aa1769f4a550 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:22.398733 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1d29d582-dec7-4534-9bf3-aa1769f4a550 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:22.407435 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1d29d582-dec7-4534-9bf3-aa1769f4a550 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:22.408941 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1d29d582-dec7-4534-9bf3-aa1769f4a550 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:22.410155 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1d29d582-dec7-4534-9bf3-aa1769f4a550 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1723 microversion: 2.20 time: 0.167870 Sep 06 21:18:22.410702 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 282/561] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:22 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:18:22.418560 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8583bd5a-e22b-4a7f-9973-634e5f6645b1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:22.419288 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8583bd5a-e22b-4a7f-9973-634e5f6645b1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:22.426589 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8583bd5a-e22b-4a7f-9973-634e5f6645b1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:22.427093 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8583bd5a-e22b-4a7f-9973-634e5f6645b1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:22.427519 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8583bd5a-e22b-4a7f-9973-634e5f6645b1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:22.428484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8583bd5a-e22b-4a7f-9973-634e5f6645b1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:22.428965 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8583bd5a-e22b-4a7f-9973-634e5f6645b1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:22.429379 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8583bd5a-e22b-4a7f-9973-634e5f6645b1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:22.520975 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8583bd5a-e22b-4a7f-9973-634e5f6645b1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:22.529846 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8583bd5a-e22b-4a7f-9973-634e5f6645b1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1194 microversion: 2.1 time: 0.124788 Sep 06 21:18:22.530903 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 280/562] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:22 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1194 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:22.582543 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5ad9c18c-a7f4-4424-96f6-29a81b6c754e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:22.583155 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5ad9c18c-a7f4-4424-96f6-29a81b6c754e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:22.593900 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ad9c18c-a7f4-4424-96f6-29a81b6c754e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:22.594313 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ad9c18c-a7f4-4424-96f6-29a81b6c754e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:22.594920 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ad9c18c-a7f4-4424-96f6-29a81b6c754e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:22.595825 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ad9c18c-a7f4-4424-96f6-29a81b6c754e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:22.596791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ad9c18c-a7f4-4424-96f6-29a81b6c754e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:22.596791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ad9c18c-a7f4-4424-96f6-29a81b6c754e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:22.848968 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5ad9c18c-a7f4-4424-96f6-29a81b6c754e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:22.859745 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5ad9c18c-a7f4-4424-96f6-29a81b6c754e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1265 microversion: 2.1 time: 0.281310 Sep 06 21:18:22.862595 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 283/563] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:22 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1265 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:23.436309 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3dc1d691-55bf-46cf-9d17-46fe73a1040e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:23.436915 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3dc1d691-55bf-46cf-9d17-46fe73a1040e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:23.445737 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3dc1d691-55bf-46cf-9d17-46fe73a1040e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:23.446467 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3dc1d691-55bf-46cf-9d17-46fe73a1040e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:23.446894 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3dc1d691-55bf-46cf-9d17-46fe73a1040e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:23.447584 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3dc1d691-55bf-46cf-9d17-46fe73a1040e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:23.448089 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3dc1d691-55bf-46cf-9d17-46fe73a1040e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:23.448551 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3dc1d691-55bf-46cf-9d17-46fe73a1040e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:23.556057 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-240d7fed-fede-4907-98b1-7bf71b6223d9 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:23.557613 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-240d7fed-fede-4907-98b1-7bf71b6223d9 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:23.568551 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-240d7fed-fede-4907-98b1-7bf71b6223d9 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:23.569170 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-240d7fed-fede-4907-98b1-7bf71b6223d9 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:23.569698 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-240d7fed-fede-4907-98b1-7bf71b6223d9 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:23.570630 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-240d7fed-fede-4907-98b1-7bf71b6223d9 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:23.571205 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-240d7fed-fede-4907-98b1-7bf71b6223d9 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:23.571741 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-240d7fed-fede-4907-98b1-7bf71b6223d9 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:23.710972 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-240d7fed-fede-4907-98b1-7bf71b6223d9 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:23.718441 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3dc1d691-55bf-46cf-9d17-46fe73a1040e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:23.719172 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-240d7fed-fede-4907-98b1-7bf71b6223d9 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1272 microversion: 2.1 time: 0.167495 Sep 06 21:18:23.719756 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 284/564] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:23 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1272 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:23.728363 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3dc1d691-55bf-46cf-9d17-46fe73a1040e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:23.730475 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3dc1d691-55bf-46cf-9d17-46fe73a1040e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:23.731786 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3dc1d691-55bf-46cf-9d17-46fe73a1040e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1723 microversion: 2.20 time: 0.300083 Sep 06 21:18:23.732431 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 281/565] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:23 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 21:18:23.886257 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a733d0d3-570d-463a-b884-3126c20908d4 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:23.888873 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a733d0d3-570d-463a-b884-3126c20908d4 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:23.896602 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a733d0d3-570d-463a-b884-3126c20908d4 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:23.897137 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a733d0d3-570d-463a-b884-3126c20908d4 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:23.897769 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a733d0d3-570d-463a-b884-3126c20908d4 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:23.898636 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a733d0d3-570d-463a-b884-3126c20908d4 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:23.899081 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a733d0d3-570d-463a-b884-3126c20908d4 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:23.899503 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a733d0d3-570d-463a-b884-3126c20908d4 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:24.069033 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a733d0d3-570d-463a-b884-3126c20908d4 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:24.078855 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a733d0d3-570d-463a-b884-3126c20908d4 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1265 microversion: 2.1 time: 0.197443 Sep 06 21:18:24.079705 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 285/566] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:23 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:24.162437 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-b3dbcd15-e64e-4137-bc81-9fdaf2e58d2d req-86512c71-3f49-44c5-a0ed-77efb1224149 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "340de6d7-883f-4c26-89b1-4f8536aa09e8", "tag": "e03713ad-150d-4e1c-af49-98c4a6fe49fe"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:18:24.172834 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b3dbcd15-e64e-4137-bc81-9fdaf2e58d2d req-86512c71-3f49-44c5-a0ed-77efb1224149 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:24.173663 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b3dbcd15-e64e-4137-bc81-9fdaf2e58d2d req-86512c71-3f49-44c5-a0ed-77efb1224149 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:24.174118 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b3dbcd15-e64e-4137-bc81-9fdaf2e58d2d req-86512c71-3f49-44c5-a0ed-77efb1224149 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:24.186189 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-b3dbcd15-e64e-4137-bc81-9fdaf2e58d2d req-86512c71-3f49-44c5-a0ed-77efb1224149 service nova] Creating event network-changed:e03713ad-150d-4e1c-af49-98c4a6fe49fe for instance 340de6d7-883f-4c26-89b1-4f8536aa09e8 on hv-cinder-74915 Sep 06 21:18:24.191291 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-b3dbcd15-e64e-4137-bc81-9fdaf2e58d2d req-86512c71-3f49-44c5-a0ed-77efb1224149 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032585 Sep 06 21:18:24.192318 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 282/567] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 21:18:24.271062 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6787ae61-cf80-49af-8b74-f74aaefca7e9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:24.271556 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6787ae61-cf80-49af-8b74-f74aaefca7e9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:24.277662 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6787ae61-cf80-49af-8b74-f74aaefca7e9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:24.278144 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6787ae61-cf80-49af-8b74-f74aaefca7e9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:24.278581 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6787ae61-cf80-49af-8b74-f74aaefca7e9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:24.279273 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6787ae61-cf80-49af-8b74-f74aaefca7e9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:24.279722 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6787ae61-cf80-49af-8b74-f74aaefca7e9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:24.280145 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6787ae61-cf80-49af-8b74-f74aaefca7e9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:24.308465 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6787ae61-cf80-49af-8b74-f74aaefca7e9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f/ips" status: 200 len: 145 microversion: 2.1 time: 0.041280 Sep 06 21:18:24.309057 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 286/568] 10.222.0.79 () {58 vars in 1248 bytes} [Tue Sep 6 21:18:24 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:18:24.744015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-54978a2c-218c-47cd-8843-ca8c15e5e410 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:24.744853 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-54978a2c-218c-47cd-8843-ca8c15e5e410 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:24.751923 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54978a2c-218c-47cd-8843-ca8c15e5e410 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:24.752412 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54978a2c-218c-47cd-8843-ca8c15e5e410 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:24.752896 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54978a2c-218c-47cd-8843-ca8c15e5e410 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:24.753629 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54978a2c-218c-47cd-8843-ca8c15e5e410 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:24.754075 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54978a2c-218c-47cd-8843-ca8c15e5e410 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:24.754501 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54978a2c-218c-47cd-8843-ca8c15e5e410 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:24.757879 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-81c4826a-b6e5-4d8c-bde3-33e23d18c49d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:24.758490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-81c4826a-b6e5-4d8c-bde3-33e23d18c49d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:24.764966 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81c4826a-b6e5-4d8c-bde3-33e23d18c49d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:24.765447 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81c4826a-b6e5-4d8c-bde3-33e23d18c49d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:24.765879 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81c4826a-b6e5-4d8c-bde3-33e23d18c49d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:24.766578 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81c4826a-b6e5-4d8c-bde3-33e23d18c49d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:24.767030 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81c4826a-b6e5-4d8c-bde3-33e23d18c49d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:24.767457 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81c4826a-b6e5-4d8c-bde3-33e23d18c49d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:24.893706 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-54978a2c-218c-47cd-8843-ca8c15e5e410 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:24.901335 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-81c4826a-b6e5-4d8c-bde3-33e23d18c49d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:24.901673 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-54978a2c-218c-47cd-8843-ca8c15e5e410 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1260 microversion: 2.1 time: 0.162667 Sep 06 21:18:24.902389 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 283/569] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:24 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:24.910240 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-81c4826a-b6e5-4d8c-bde3-33e23d18c49d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:24.911681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-81c4826a-b6e5-4d8c-bde3-33e23d18c49d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:24.912910 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-81c4826a-b6e5-4d8c-bde3-33e23d18c49d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1723 microversion: 2.20 time: 0.159125 Sep 06 21:18:24.913446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 287/570] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:24 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:18:25.103875 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5b97011e-fe25-4381-82f4-40359bfb3857 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:25.104515 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5b97011e-fe25-4381-82f4-40359bfb3857 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:25.111242 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b97011e-fe25-4381-82f4-40359bfb3857 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:25.111727 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b97011e-fe25-4381-82f4-40359bfb3857 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:25.112166 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b97011e-fe25-4381-82f4-40359bfb3857 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:25.112965 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b97011e-fe25-4381-82f4-40359bfb3857 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:25.113425 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b97011e-fe25-4381-82f4-40359bfb3857 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:25.113847 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b97011e-fe25-4381-82f4-40359bfb3857 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:25.248319 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5b97011e-fe25-4381-82f4-40359bfb3857 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:25.258136 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5b97011e-fe25-4381-82f4-40359bfb3857 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1265 microversion: 2.1 time: 0.158126 Sep 06 21:18:25.258737 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 284/571] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:25 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:25.926098 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e96efdcc-56f8-4be8-81c3-ec400130ddca tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:25.926735 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e96efdcc-56f8-4be8-81c3-ec400130ddca tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:25.933588 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e96efdcc-56f8-4be8-81c3-ec400130ddca tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:25.934073 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e96efdcc-56f8-4be8-81c3-ec400130ddca tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:25.934508 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e96efdcc-56f8-4be8-81c3-ec400130ddca tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:25.935214 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e96efdcc-56f8-4be8-81c3-ec400130ddca tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:25.935790 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e96efdcc-56f8-4be8-81c3-ec400130ddca tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:25.936218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e96efdcc-56f8-4be8-81c3-ec400130ddca tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:25.942141 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e9369ada-a6fd-4076-b62f-0e2b14f32f18 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:25.942798 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e9369ada-a6fd-4076-b62f-0e2b14f32f18 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:25.951072 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9369ada-a6fd-4076-b62f-0e2b14f32f18 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:25.951705 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9369ada-a6fd-4076-b62f-0e2b14f32f18 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:25.952356 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9369ada-a6fd-4076-b62f-0e2b14f32f18 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:25.954788 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9369ada-a6fd-4076-b62f-0e2b14f32f18 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:25.955232 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9369ada-a6fd-4076-b62f-0e2b14f32f18 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:25.955656 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9369ada-a6fd-4076-b62f-0e2b14f32f18 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:26.101050 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e96efdcc-56f8-4be8-81c3-ec400130ddca tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:26.109710 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e96efdcc-56f8-4be8-81c3-ec400130ddca tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1260 microversion: 2.1 time: 0.188276 Sep 06 21:18:26.110276 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 288/572] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:25 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:26.126260 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e9369ada-a6fd-4076-b62f-0e2b14f32f18 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:26.135015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e9369ada-a6fd-4076-b62f-0e2b14f32f18 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:26.136742 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e9369ada-a6fd-4076-b62f-0e2b14f32f18 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:26.138009 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e9369ada-a6fd-4076-b62f-0e2b14f32f18 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1723 microversion: 2.20 time: 0.202770 Sep 06 21:18:26.138562 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 285/573] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:25 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:18:26.281918 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fd40e4b7-06ba-448b-8cf3-d91d4146763d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:26.282838 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fd40e4b7-06ba-448b-8cf3-d91d4146763d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:26.290433 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd40e4b7-06ba-448b-8cf3-d91d4146763d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:26.290917 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd40e4b7-06ba-448b-8cf3-d91d4146763d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:26.291346 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd40e4b7-06ba-448b-8cf3-d91d4146763d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:26.292083 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd40e4b7-06ba-448b-8cf3-d91d4146763d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:26.292566 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd40e4b7-06ba-448b-8cf3-d91d4146763d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:26.294039 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd40e4b7-06ba-448b-8cf3-d91d4146763d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:26.431189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-fd40e4b7-06ba-448b-8cf3-d91d4146763d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:26.440294 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fd40e4b7-06ba-448b-8cf3-d91d4146763d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1265 microversion: 2.1 time: 0.162364 Sep 06 21:18:26.440902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 289/574] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:26 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:18:27.133240 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ae1772f8-df69-4d65-a41e-3b2f2e5b98d6 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:27.133779 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ae1772f8-df69-4d65-a41e-3b2f2e5b98d6 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:27.135800 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:18:27.136459 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:18:27.142859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae1772f8-df69-4d65-a41e-3b2f2e5b98d6 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:27.143325 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae1772f8-df69-4d65-a41e-3b2f2e5b98d6 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:27.143748 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae1772f8-df69-4d65-a41e-3b2f2e5b98d6 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:27.144430 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae1772f8-df69-4d65-a41e-3b2f2e5b98d6 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:27.145102 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae1772f8-df69-4d65-a41e-3b2f2e5b98d6 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:27.145553 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae1772f8-df69-4d65-a41e-3b2f2e5b98d6 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:27.163624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eb3bbfe4-0e36-407c-90ea-4a56d2e2fddf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:27.164892 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-eb3bbfe4-0e36-407c-90ea-4a56d2e2fddf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:27.167321 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:18:27.168018 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:18:27.174709 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb3bbfe4-0e36-407c-90ea-4a56d2e2fddf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:27.175202 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb3bbfe4-0e36-407c-90ea-4a56d2e2fddf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:27.175642 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb3bbfe4-0e36-407c-90ea-4a56d2e2fddf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:27.176352 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb3bbfe4-0e36-407c-90ea-4a56d2e2fddf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:27.176837 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb3bbfe4-0e36-407c-90ea-4a56d2e2fddf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:27.177262 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb3bbfe4-0e36-407c-90ea-4a56d2e2fddf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:27.302221 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ae1772f8-df69-4d65-a41e-3b2f2e5b98d6 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:27.311291 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ae1772f8-df69-4d65-a41e-3b2f2e5b98d6 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1260 microversion: 2.1 time: 0.181915 Sep 06 21:18:27.311870 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 286/575] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:27 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:27.324926 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-eb3bbfe4-0e36-407c-90ea-4a56d2e2fddf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:27.326925 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-eb3bbfe4-0e36-407c-90ea-4a56d2e2fddf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:27.328478 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-eb3bbfe4-0e36-407c-90ea-4a56d2e2fddf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:27.329800 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-eb3bbfe4-0e36-407c-90ea-4a56d2e2fddf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1723 microversion: 2.20 time: 0.170311 Sep 06 21:18:27.330346 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 290/576] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:27 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:18:27.463846 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-938f784b-f927-4182-9063-1b77b32cff4f tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:27.464453 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-938f784b-f927-4182-9063-1b77b32cff4f tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:27.471099 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-938f784b-f927-4182-9063-1b77b32cff4f tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:27.471577 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-938f784b-f927-4182-9063-1b77b32cff4f tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:27.472102 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-938f784b-f927-4182-9063-1b77b32cff4f tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:27.473909 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-938f784b-f927-4182-9063-1b77b32cff4f tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:27.474392 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-938f784b-f927-4182-9063-1b77b32cff4f tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:27.474812 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-938f784b-f927-4182-9063-1b77b32cff4f tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:27.608637 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-938f784b-f927-4182-9063-1b77b32cff4f tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:27.616563 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-938f784b-f927-4182-9063-1b77b32cff4f tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1452 microversion: 2.1 time: 0.156677 Sep 06 21:18:27.617167 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 287/577] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:27 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:27.639358 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bafdf30e-c24e-4475-b5e3-e346794a0e15 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:27.639956 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bafdf30e-c24e-4475-b5e3-e346794a0e15 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:27.646212 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bafdf30e-c24e-4475-b5e3-e346794a0e15 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:27.646690 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bafdf30e-c24e-4475-b5e3-e346794a0e15 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:27.647117 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bafdf30e-c24e-4475-b5e3-e346794a0e15 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:27.647807 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bafdf30e-c24e-4475-b5e3-e346794a0e15 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:27.648242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bafdf30e-c24e-4475-b5e3-e346794a0e15 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:27.648748 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bafdf30e-c24e-4475-b5e3-e346794a0e15 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:27.790775 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-bafdf30e-c24e-4475-b5e3-e346794a0e15 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:27.799743 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bafdf30e-c24e-4475-b5e3-e346794a0e15 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1452 microversion: 2.1 time: 0.164212 Sep 06 21:18:27.800300 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 291/578] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:27 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:28.334434 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-48a66753-524f-48ed-8857-7791971e52ee tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:28.335037 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-48a66753-524f-48ed-8857-7791971e52ee tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:28.343413 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:18:28.354967 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-779dc33c-6ca8-4d7e-bead-58696599c810 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:28.355552 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-779dc33c-6ca8-4d7e-bead-58696599c810 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:28.370170 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a66753-524f-48ed-8857-7791971e52ee tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:28.370723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a66753-524f-48ed-8857-7791971e52ee tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:28.371166 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a66753-524f-48ed-8857-7791971e52ee tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:28.372025 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a66753-524f-48ed-8857-7791971e52ee tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:28.372301 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a66753-524f-48ed-8857-7791971e52ee tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:28.372739 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48a66753-524f-48ed-8857-7791971e52ee tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:28.386116 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-779dc33c-6ca8-4d7e-bead-58696599c810 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:28.386601 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-779dc33c-6ca8-4d7e-bead-58696599c810 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:28.387029 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-779dc33c-6ca8-4d7e-bead-58696599c810 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:28.387728 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-779dc33c-6ca8-4d7e-bead-58696599c810 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:28.388170 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-779dc33c-6ca8-4d7e-bead-58696599c810 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:28.388564 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-779dc33c-6ca8-4d7e-bead-58696599c810 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:28.542675 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-48a66753-524f-48ed-8857-7791971e52ee tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:28.551404 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-48a66753-524f-48ed-8857-7791971e52ee tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1260 microversion: 2.1 time: 0.220735 Sep 06 21:18:28.551968 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 288/579] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:28 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1260 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:18:28.659567 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-779dc33c-6ca8-4d7e-bead-58696599c810 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:28.668303 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-779dc33c-6ca8-4d7e-bead-58696599c810 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:28.669750 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-779dc33c-6ca8-4d7e-bead-58696599c810 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:28.670907 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-779dc33c-6ca8-4d7e-bead-58696599c810 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1723 microversion: 2.20 time: 0.319933 Sep 06 21:18:28.671460 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 292/580] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:28 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1723 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 21:18:29.268005 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9ce35b86-be84-40c1-9f43-0844bf31164b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-844510540", "imageRef": "8b4a7612-517c-4711-8637-36b221338f65", "flavorRef": "452", "networks": [{"uuid": "1040fd1e-1111-4899-86bc-abf763096bc8"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:18:29.325199 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-9ce35b86-be84-40c1-9f43-0844bf31164b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] validate_networks() for [('1040fd1e-1111-4899-86bc-abf763096bc8', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 21:18:29.575822 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7a53e028-e888-4eb0-be57-fe02a3972a1e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:29.576436 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7a53e028-e888-4eb0-be57-fe02a3972a1e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:29.596714 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a53e028-e888-4eb0-be57-fe02a3972a1e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:29.597502 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a53e028-e888-4eb0-be57-fe02a3972a1e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:29.598129 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a53e028-e888-4eb0-be57-fe02a3972a1e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:29.599119 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a53e028-e888-4eb0-be57-fe02a3972a1e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:29.599695 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a53e028-e888-4eb0-be57-fe02a3972a1e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:29.600185 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a53e028-e888-4eb0-be57-fe02a3972a1e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:29.607842 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:18:29.946307 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7a53e028-e888-4eb0-be57-fe02a3972a1e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:29.954992 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7a53e028-e888-4eb0-be57-fe02a3972a1e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1260 microversion: 2.1 time: 0.383347 Sep 06 21:18:29.956181 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 293/581] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:29 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1260 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:29.961494 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0902d5c3-1056-4ae6-a68d-807538ef9623 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:29.962383 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0902d5c3-1056-4ae6-a68d-807538ef9623 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:29.971303 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0902d5c3-1056-4ae6-a68d-807538ef9623 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:29.972820 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0902d5c3-1056-4ae6-a68d-807538ef9623 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:29.973480 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0902d5c3-1056-4ae6-a68d-807538ef9623 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:29.974198 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0902d5c3-1056-4ae6-a68d-807538ef9623 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:29.974671 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0902d5c3-1056-4ae6-a68d-807538ef9623 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:29.975374 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0902d5c3-1056-4ae6-a68d-807538ef9623 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:30.192218 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-9ce35b86-be84-40c1-9f43-0844bf31164b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 21:18:30.192764 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-9ce35b86-be84-40c1-9f43-0844bf31164b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 21:18:30.193404 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-9ce35b86-be84-40c1-9f43-0844bf31164b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 21:18:30.194191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-9ce35b86-be84-40c1-9f43-0844bf31164b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 21:18:30.194699 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-9ce35b86-be84-40c1-9f43-0844bf31164b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 21:18:30.209612 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ce35b86-be84-40c1-9f43-0844bf31164b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:30.210202 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ce35b86-be84-40c1-9f43-0844bf31164b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:30.210714 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ce35b86-be84-40c1-9f43-0844bf31164b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:30.211573 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ce35b86-be84-40c1-9f43-0844bf31164b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:30.212228 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ce35b86-be84-40c1-9f43-0844bf31164b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:30.212679 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ce35b86-be84-40c1-9f43-0844bf31164b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:30.231804 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0902d5c3-1056-4ae6-a68d-807538ef9623 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:30.234753 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-9ce35b86-be84-40c1-9f43-0844bf31164b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Getting quotas for project 3c0901a228de4c59bc0e999f55bc1e08. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:18:30.243434 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-9ce35b86-be84-40c1-9f43-0844bf31164b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Getting quotas for user 71e0c39501bf48c2a63257a4cf75def1 and project 3c0901a228de4c59bc0e999f55bc1e08. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:18:30.244560 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0902d5c3-1056-4ae6-a68d-807538ef9623 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:30.246357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0902d5c3-1056-4ae6-a68d-807538ef9623 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:30.248520 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0902d5c3-1056-4ae6-a68d-807538ef9623 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1723 microversion: 2.20 time: 0.291341 Sep 06 21:18:30.249300 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 294/582] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:29 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1723 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:18:30.263001 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9ce35b86-be84-40c1-9f43-0844bf31164b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 21:18:30.265768 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9ce35b86-be84-40c1-9f43-0844bf31164b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8b4a7612-517c-4711-8637-36b221338f65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 21:18:30.320142 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9ce35b86-be84-40c1-9f43-0844bf31164b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.054852 Sep 06 21:18:30.321355 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 289/583] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Sep 6 21:18:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 21:18:30.334404 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0be28153-5a79-4b9e-9981-2e634f930855 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:30.335173 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0be28153-5a79-4b9e-9981-2e634f930855 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:30.423640 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0be28153-5a79-4b9e-9981-2e634f930855 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:30.431409 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0be28153-5a79-4b9e-9981-2e634f930855 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1218 microversion: 2.1 time: 0.102272 Sep 06 21:18:30.434224 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 295/584] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:30 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:30.480982 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-ea6f236c-df9a-4550-a878-0998bc2e5341 req-cfafc742-d011-4dea-ba18-96edc1090a11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8d6fc21-502d-41ec-8216-29ad57153010", "tag": "8d3992ee-ded1-4b3c-8436-fe6805e12ddd"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:18:30.495569 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ea6f236c-df9a-4550-a878-0998bc2e5341 req-cfafc742-d011-4dea-ba18-96edc1090a11 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:30.496348 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ea6f236c-df9a-4550-a878-0998bc2e5341 req-cfafc742-d011-4dea-ba18-96edc1090a11 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:30.496999 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ea6f236c-df9a-4550-a878-0998bc2e5341 req-cfafc742-d011-4dea-ba18-96edc1090a11 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:30.512797 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-ea6f236c-df9a-4550-a878-0998bc2e5341 req-cfafc742-d011-4dea-ba18-96edc1090a11 service nova] Creating event network-changed:8d3992ee-ded1-4b3c-8436-fe6805e12ddd for instance a8d6fc21-502d-41ec-8216-29ad57153010 on hv-cinder-74915 Sep 06 21:18:30.521009 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-ea6f236c-df9a-4550-a878-0998bc2e5341 req-cfafc742-d011-4dea-ba18-96edc1090a11 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045263 Sep 06 21:18:30.521695 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 290/585] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:18:30.566133 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-13613d38-a107-4b30-97d5-5ea40dc93303 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "756f783c-b492-45ea-8572-963bb9896c1a"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:18:30.568841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-13613d38-a107-4b30-97d5-5ea40dc93303 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:30.577707 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13613d38-a107-4b30-97d5-5ea40dc93303 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:30.578982 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13613d38-a107-4b30-97d5-5ea40dc93303 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:30.579522 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13613d38-a107-4b30-97d5-5ea40dc93303 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:30.580386 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13613d38-a107-4b30-97d5-5ea40dc93303 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:30.581544 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13613d38-a107-4b30-97d5-5ea40dc93303 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:30.582078 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13613d38-a107-4b30-97d5-5ea40dc93303 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:30.991957 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-db1418f7-2654-4d13-a9e3-ac6906fb87e9 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:30.992648 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-db1418f7-2654-4d13-a9e3-ac6906fb87e9 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:30.999636 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db1418f7-2654-4d13-a9e3-ac6906fb87e9 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:31.000119 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db1418f7-2654-4d13-a9e3-ac6906fb87e9 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:31.000550 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db1418f7-2654-4d13-a9e3-ac6906fb87e9 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:31.001278 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db1418f7-2654-4d13-a9e3-ac6906fb87e9 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:31.001724 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db1418f7-2654-4d13-a9e3-ac6906fb87e9 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:31.002146 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db1418f7-2654-4d13-a9e3-ac6906fb87e9 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:31.137092 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-db1418f7-2654-4d13-a9e3-ac6906fb87e9 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:31.145173 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-db1418f7-2654-4d13-a9e3-ac6906fb87e9 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1260 microversion: 2.1 time: 0.157492 Sep 06 21:18:31.145785 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 291/586] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:30 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:18:31.274687 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f93fff5d-596d-4dd2-914a-b8c82097592d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:31.275367 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f93fff5d-596d-4dd2-914a-b8c82097592d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:31.281653 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f93fff5d-596d-4dd2-914a-b8c82097592d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:31.282324 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f93fff5d-596d-4dd2-914a-b8c82097592d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:31.282891 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f93fff5d-596d-4dd2-914a-b8c82097592d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:31.283632 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f93fff5d-596d-4dd2-914a-b8c82097592d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:31.284330 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f93fff5d-596d-4dd2-914a-b8c82097592d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:31.284904 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f93fff5d-596d-4dd2-914a-b8c82097592d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:31.430492 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f93fff5d-596d-4dd2-914a-b8c82097592d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:31.440458 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f93fff5d-596d-4dd2-914a-b8c82097592d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:31.441978 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f93fff5d-596d-4dd2-914a-b8c82097592d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:31.443243 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f93fff5d-596d-4dd2-914a-b8c82097592d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1723 microversion: 2.20 time: 0.172515 Sep 06 21:18:31.443816 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 292/587] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:31 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:18:31.462218 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1a2fbbe4-85bd-4150-ac0f-86f07113eee9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:31.462796 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1a2fbbe4-85bd-4150-ac0f-86f07113eee9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:31.469360 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a2fbbe4-85bd-4150-ac0f-86f07113eee9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:31.469846 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a2fbbe4-85bd-4150-ac0f-86f07113eee9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:31.470274 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a2fbbe4-85bd-4150-ac0f-86f07113eee9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:31.471004 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a2fbbe4-85bd-4150-ac0f-86f07113eee9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:31.471465 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a2fbbe4-85bd-4150-ac0f-86f07113eee9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:31.471874 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a2fbbe4-85bd-4150-ac0f-86f07113eee9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:31.548064 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1a2fbbe4-85bd-4150-ac0f-86f07113eee9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:31.557360 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1a2fbbe4-85bd-4150-ac0f-86f07113eee9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1222 microversion: 2.1 time: 0.099079 Sep 06 21:18:31.557960 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 293/588] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:31 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1222 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:32.106728 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-13613d38-a107-4b30-97d5-5ea40dc93303 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "POST /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.543881 Sep 06 21:18:32.109497 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 296/589] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Sep 6 21:18:30 2022] POST /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f/os-volume_attachments => generated 194 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:18:32.172806 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-20a42106-b4c0-47c4-bb0a-dda06a308dc2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:32.174156 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-20a42106-b4c0-47c4-bb0a-dda06a308dc2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:32.182303 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20a42106-b4c0-47c4-bb0a-dda06a308dc2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:32.182969 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20a42106-b4c0-47c4-bb0a-dda06a308dc2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:32.183332 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20a42106-b4c0-47c4-bb0a-dda06a308dc2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:32.184044 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20a42106-b4c0-47c4-bb0a-dda06a308dc2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:32.184861 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20a42106-b4c0-47c4-bb0a-dda06a308dc2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:32.185076 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20a42106-b4c0-47c4-bb0a-dda06a308dc2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:32.210407 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:18:32.401282 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-20a42106-b4c0-47c4-bb0a-dda06a308dc2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:32.416159 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-20a42106-b4c0-47c4-bb0a-dda06a308dc2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1260 microversion: 2.1 time: 0.251439 Sep 06 21:18:32.417251 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 294/590] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:32 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1260 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:18:32.478195 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1e3b599e-6169-4d5a-92fd-8bf1fa9075fc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:32.478492 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1e3b599e-6169-4d5a-92fd-8bf1fa9075fc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:32.487028 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e3b599e-6169-4d5a-92fd-8bf1fa9075fc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:32.487532 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e3b599e-6169-4d5a-92fd-8bf1fa9075fc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:32.487968 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e3b599e-6169-4d5a-92fd-8bf1fa9075fc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:32.489097 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e3b599e-6169-4d5a-92fd-8bf1fa9075fc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:32.489538 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e3b599e-6169-4d5a-92fd-8bf1fa9075fc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:32.490232 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e3b599e-6169-4d5a-92fd-8bf1fa9075fc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:32.580121 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-30e33f6c-ac06-43e2-8506-30f261b77c30 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:32.581252 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-30e33f6c-ac06-43e2-8506-30f261b77c30 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:32.588250 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30e33f6c-ac06-43e2-8506-30f261b77c30 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:32.588918 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30e33f6c-ac06-43e2-8506-30f261b77c30 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:32.590307 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30e33f6c-ac06-43e2-8506-30f261b77c30 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:32.591073 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30e33f6c-ac06-43e2-8506-30f261b77c30 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:32.591757 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30e33f6c-ac06-43e2-8506-30f261b77c30 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:32.592292 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30e33f6c-ac06-43e2-8506-30f261b77c30 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:32.646859 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1e3b599e-6169-4d5a-92fd-8bf1fa9075fc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:32.655800 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1e3b599e-6169-4d5a-92fd-8bf1fa9075fc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:32.657374 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1e3b599e-6169-4d5a-92fd-8bf1fa9075fc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:32.658658 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1e3b599e-6169-4d5a-92fd-8bf1fa9075fc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1723 microversion: 2.20 time: 0.190001 Sep 06 21:18:32.659446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 297/591] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:32 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:18:32.660075 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-30e33f6c-ac06-43e2-8506-30f261b77c30 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:32.672642 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-30e33f6c-ac06-43e2-8506-30f261b77c30 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1270 microversion: 2.1 time: 0.096693 Sep 06 21:18:32.673801 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 295/592] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:32 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:33.441429 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f466ed0d-4f8b-44b5-b1e1-1814c334d93e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:33.442885 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f466ed0d-4f8b-44b5-b1e1-1814c334d93e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:33.449640 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f466ed0d-4f8b-44b5-b1e1-1814c334d93e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:33.450142 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f466ed0d-4f8b-44b5-b1e1-1814c334d93e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:33.450645 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f466ed0d-4f8b-44b5-b1e1-1814c334d93e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:33.451418 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f466ed0d-4f8b-44b5-b1e1-1814c334d93e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:33.451924 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f466ed0d-4f8b-44b5-b1e1-1814c334d93e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:33.452427 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f466ed0d-4f8b-44b5-b1e1-1814c334d93e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:33.597796 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f466ed0d-4f8b-44b5-b1e1-1814c334d93e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:33.606893 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f466ed0d-4f8b-44b5-b1e1-1814c334d93e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1260 microversion: 2.1 time: 0.170539 Sep 06 21:18:33.607745 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 298/593] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:33 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:33.685915 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-001a1c7e-085f-4476-a083-cee5a536a264 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:33.686719 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-001a1c7e-085f-4476-a083-cee5a536a264 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:33.696016 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-001a1c7e-085f-4476-a083-cee5a536a264 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:33.696498 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-001a1c7e-085f-4476-a083-cee5a536a264 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:33.696964 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-001a1c7e-085f-4476-a083-cee5a536a264 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:33.697675 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-001a1c7e-085f-4476-a083-cee5a536a264 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:33.698125 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-001a1c7e-085f-4476-a083-cee5a536a264 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:33.698550 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-001a1c7e-085f-4476-a083-cee5a536a264 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:33.706026 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-90fd8ad3-c3ca-490c-bd96-0f796558974b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:33.706645 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-90fd8ad3-c3ca-490c-bd96-0f796558974b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:33.713284 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90fd8ad3-c3ca-490c-bd96-0f796558974b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:33.713845 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90fd8ad3-c3ca-490c-bd96-0f796558974b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:33.714243 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90fd8ad3-c3ca-490c-bd96-0f796558974b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:33.715245 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90fd8ad3-c3ca-490c-bd96-0f796558974b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:33.715708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90fd8ad3-c3ca-490c-bd96-0f796558974b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:33.716125 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90fd8ad3-c3ca-490c-bd96-0f796558974b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:33.848407 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-90fd8ad3-c3ca-490c-bd96-0f796558974b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:33.856426 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-90fd8ad3-c3ca-490c-bd96-0f796558974b tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1318 microversion: 2.1 time: 0.164455 Sep 06 21:18:33.857424 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 299/594] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:33 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:33.893461 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-001a1c7e-085f-4476-a083-cee5a536a264 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:33.902676 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-001a1c7e-085f-4476-a083-cee5a536a264 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:33.904121 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-001a1c7e-085f-4476-a083-cee5a536a264 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:33.905337 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-001a1c7e-085f-4476-a083-cee5a536a264 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1723 microversion: 2.20 time: 0.223732 Sep 06 21:18:33.906094 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 296/595] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:33 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:18:34.469922 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-140282b5-478b-46cb-ab7f-1f38cebd82c0 req-bf091f71-07f0-475d-b61b-7ca6f5704835 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0652742c-8554-4c35-89cd-8ff0fb44659f", "tag": "d7f4717c-96be-4a44-bf93-cbe0186339a1"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:18:34.481763 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-140282b5-478b-46cb-ab7f-1f38cebd82c0 req-bf091f71-07f0-475d-b61b-7ca6f5704835 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:34.482328 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-140282b5-478b-46cb-ab7f-1f38cebd82c0 req-bf091f71-07f0-475d-b61b-7ca6f5704835 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:34.482723 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-140282b5-478b-46cb-ab7f-1f38cebd82c0 req-bf091f71-07f0-475d-b61b-7ca6f5704835 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:34.495732 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-140282b5-478b-46cb-ab7f-1f38cebd82c0 req-bf091f71-07f0-475d-b61b-7ca6f5704835 service nova] Creating event network-changed:d7f4717c-96be-4a44-bf93-cbe0186339a1 for instance 0652742c-8554-4c35-89cd-8ff0fb44659f on hv-cinder-74915 Sep 06 21:18:34.500566 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-140282b5-478b-46cb-ab7f-1f38cebd82c0 req-bf091f71-07f0-475d-b61b-7ca6f5704835 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034564 Sep 06 21:18:34.501224 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 300/596] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 21:18:34.630846 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e550fdce-97e8-4759-9fff-f7c3a6460387 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:34.631370 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e550fdce-97e8-4759-9fff-f7c3a6460387 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:34.638961 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e550fdce-97e8-4759-9fff-f7c3a6460387 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:34.639504 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e550fdce-97e8-4759-9fff-f7c3a6460387 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:34.640041 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e550fdce-97e8-4759-9fff-f7c3a6460387 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:34.641055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e550fdce-97e8-4759-9fff-f7c3a6460387 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:34.641578 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e550fdce-97e8-4759-9fff-f7c3a6460387 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:34.641990 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e550fdce-97e8-4759-9fff-f7c3a6460387 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:34.875599 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e550fdce-97e8-4759-9fff-f7c3a6460387 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:34.885848 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4c54fdc3-241e-4f78-b49a-6cacf11dc8c1 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:34.887025 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4c54fdc3-241e-4f78-b49a-6cacf11dc8c1 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:34.888928 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e550fdce-97e8-4759-9fff-f7c3a6460387 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1260 microversion: 2.1 time: 0.261891 Sep 06 21:18:34.889927 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 297/597] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:34 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1260 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:34.895482 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c54fdc3-241e-4f78-b49a-6cacf11dc8c1 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:34.896080 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c54fdc3-241e-4f78-b49a-6cacf11dc8c1 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:34.896583 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c54fdc3-241e-4f78-b49a-6cacf11dc8c1 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:34.897368 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c54fdc3-241e-4f78-b49a-6cacf11dc8c1 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:34.897891 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c54fdc3-241e-4f78-b49a-6cacf11dc8c1 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:34.898361 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c54fdc3-241e-4f78-b49a-6cacf11dc8c1 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:34.935733 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-77425d05-0e2f-46e0-908a-bbf619a6bb70 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:34.936925 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-77425d05-0e2f-46e0-908a-bbf619a6bb70 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:34.955736 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77425d05-0e2f-46e0-908a-bbf619a6bb70 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:34.956249 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77425d05-0e2f-46e0-908a-bbf619a6bb70 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:34.956691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77425d05-0e2f-46e0-908a-bbf619a6bb70 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:34.958006 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77425d05-0e2f-46e0-908a-bbf619a6bb70 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:34.958445 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77425d05-0e2f-46e0-908a-bbf619a6bb70 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:34.958862 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77425d05-0e2f-46e0-908a-bbf619a6bb70 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:35.044342 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4c54fdc3-241e-4f78-b49a-6cacf11dc8c1 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:35.052461 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4c54fdc3-241e-4f78-b49a-6cacf11dc8c1 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1318 microversion: 2.1 time: 0.175411 Sep 06 21:18:35.053055 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 301/598] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:34 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:35.114703 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-77425d05-0e2f-46e0-908a-bbf619a6bb70 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:35.123289 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-77425d05-0e2f-46e0-908a-bbf619a6bb70 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:35.124779 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-77425d05-0e2f-46e0-908a-bbf619a6bb70 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:35.125965 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-77425d05-0e2f-46e0-908a-bbf619a6bb70 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1723 microversion: 2.20 time: 0.197149 Sep 06 21:18:35.126523 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 298/599] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:34 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:18:35.912474 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-edac3d4a-9609-414d-ba23-62c7038f7786 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:35.913068 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-edac3d4a-9609-414d-ba23-62c7038f7786 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:35.920155 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edac3d4a-9609-414d-ba23-62c7038f7786 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:35.920640 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edac3d4a-9609-414d-ba23-62c7038f7786 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:35.921099 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edac3d4a-9609-414d-ba23-62c7038f7786 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:35.921779 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edac3d4a-9609-414d-ba23-62c7038f7786 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:35.922222 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edac3d4a-9609-414d-ba23-62c7038f7786 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:35.922644 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-edac3d4a-9609-414d-ba23-62c7038f7786 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:36.060765 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-edac3d4a-9609-414d-ba23-62c7038f7786 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:36.070782 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-edac3d4a-9609-414d-ba23-62c7038f7786 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1260 microversion: 2.1 time: 0.162253 Sep 06 21:18:36.071558 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 302/600] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:35 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:36.077000 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f044fb92-3665-43bb-9303-b741e8359f5a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:36.077693 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f044fb92-3665-43bb-9303-b741e8359f5a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:36.086151 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f044fb92-3665-43bb-9303-b741e8359f5a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:36.086628 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f044fb92-3665-43bb-9303-b741e8359f5a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:36.087060 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f044fb92-3665-43bb-9303-b741e8359f5a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:36.087903 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f044fb92-3665-43bb-9303-b741e8359f5a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:36.088484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f044fb92-3665-43bb-9303-b741e8359f5a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:36.089250 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f044fb92-3665-43bb-9303-b741e8359f5a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:36.151423 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6725dc59-9fc9-4493-a0a6-ddd9ac1d4d7e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:36.152029 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6725dc59-9fc9-4493-a0a6-ddd9ac1d4d7e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:36.158755 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6725dc59-9fc9-4493-a0a6-ddd9ac1d4d7e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:36.159245 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6725dc59-9fc9-4493-a0a6-ddd9ac1d4d7e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:36.159651 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6725dc59-9fc9-4493-a0a6-ddd9ac1d4d7e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:36.160389 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6725dc59-9fc9-4493-a0a6-ddd9ac1d4d7e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:36.160980 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6725dc59-9fc9-4493-a0a6-ddd9ac1d4d7e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:36.161415 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6725dc59-9fc9-4493-a0a6-ddd9ac1d4d7e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:36.241081 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f044fb92-3665-43bb-9303-b741e8359f5a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:36.249254 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f044fb92-3665-43bb-9303-b741e8359f5a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1318 microversion: 2.1 time: 0.177616 Sep 06 21:18:36.249831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 299/601] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:36 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:36.318198 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6725dc59-9fc9-4493-a0a6-ddd9ac1d4d7e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:36.326611 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6725dc59-9fc9-4493-a0a6-ddd9ac1d4d7e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:36.328854 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6725dc59-9fc9-4493-a0a6-ddd9ac1d4d7e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:36.330100 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6725dc59-9fc9-4493-a0a6-ddd9ac1d4d7e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1723 microversion: 2.20 time: 0.182660 Sep 06 21:18:36.330646 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 303/602] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:36 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 21:18:37.097690 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-43417b7a-9e82-4924-b717-4bcf478119c2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:37.098310 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-43417b7a-9e82-4924-b717-4bcf478119c2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:37.105295 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43417b7a-9e82-4924-b717-4bcf478119c2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:37.105668 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43417b7a-9e82-4924-b717-4bcf478119c2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:37.106088 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43417b7a-9e82-4924-b717-4bcf478119c2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:37.106789 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43417b7a-9e82-4924-b717-4bcf478119c2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:37.107311 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43417b7a-9e82-4924-b717-4bcf478119c2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:37.107728 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43417b7a-9e82-4924-b717-4bcf478119c2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:37.239620 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-43417b7a-9e82-4924-b717-4bcf478119c2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:37.247626 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-43417b7a-9e82-4924-b717-4bcf478119c2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1260 microversion: 2.1 time: 0.153886 Sep 06 21:18:37.248184 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 300/603] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:37 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:37.271668 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dc7201c1-c8f5-4bf7-a725-08e7718ad7d5 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:37.272274 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dc7201c1-c8f5-4bf7-a725-08e7718ad7d5 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:37.279043 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc7201c1-c8f5-4bf7-a725-08e7718ad7d5 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:37.279519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc7201c1-c8f5-4bf7-a725-08e7718ad7d5 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:37.279945 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc7201c1-c8f5-4bf7-a725-08e7718ad7d5 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:37.280636 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc7201c1-c8f5-4bf7-a725-08e7718ad7d5 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:37.281114 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc7201c1-c8f5-4bf7-a725-08e7718ad7d5 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:37.281527 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc7201c1-c8f5-4bf7-a725-08e7718ad7d5 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:37.355774 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4b3d512b-33e3-443c-a861-6188e96a2d1b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:37.356470 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4b3d512b-33e3-443c-a861-6188e96a2d1b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:37.363027 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b3d512b-33e3-443c-a861-6188e96a2d1b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:37.363506 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b3d512b-33e3-443c-a861-6188e96a2d1b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:37.363934 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b3d512b-33e3-443c-a861-6188e96a2d1b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:37.365188 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b3d512b-33e3-443c-a861-6188e96a2d1b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:37.365188 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b3d512b-33e3-443c-a861-6188e96a2d1b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:37.365512 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b3d512b-33e3-443c-a861-6188e96a2d1b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:37.423463 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-dc7201c1-c8f5-4bf7-a725-08e7718ad7d5 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:37.432472 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dc7201c1-c8f5-4bf7-a725-08e7718ad7d5 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1318 microversion: 2.1 time: 0.164909 Sep 06 21:18:37.433108 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 304/604] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:37 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:37.510309 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4b3d512b-33e3-443c-a861-6188e96a2d1b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:37.519145 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4b3d512b-33e3-443c-a861-6188e96a2d1b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:37.520587 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4b3d512b-33e3-443c-a861-6188e96a2d1b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:37.521792 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4b3d512b-33e3-443c-a861-6188e96a2d1b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1723 microversion: 2.20 time: 0.170135 Sep 06 21:18:37.522711 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 301/605] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:37 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:18:38.273681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-50de77a0-b4aa-4945-b574-57cbdf32344c tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:38.274655 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-50de77a0-b4aa-4945-b574-57cbdf32344c tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:38.283529 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50de77a0-b4aa-4945-b574-57cbdf32344c tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:38.284269 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50de77a0-b4aa-4945-b574-57cbdf32344c tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:38.284981 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50de77a0-b4aa-4945-b574-57cbdf32344c tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:38.285666 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50de77a0-b4aa-4945-b574-57cbdf32344c tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:38.286114 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50de77a0-b4aa-4945-b574-57cbdf32344c tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:38.286585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50de77a0-b4aa-4945-b574-57cbdf32344c tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:38.444516 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-50de77a0-b4aa-4945-b574-57cbdf32344c tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:38.454566 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-50de77a0-b4aa-4945-b574-57cbdf32344c tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1260 microversion: 2.1 time: 0.185312 Sep 06 21:18:38.454566 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 305/606] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:38 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:38.455732 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c63f4ede-1744-4f72-ac9b-e8f8f4e0c479 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:38.456345 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c63f4ede-1744-4f72-ac9b-e8f8f4e0c479 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:38.463893 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c63f4ede-1744-4f72-ac9b-e8f8f4e0c479 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:38.464702 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c63f4ede-1744-4f72-ac9b-e8f8f4e0c479 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:38.465465 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c63f4ede-1744-4f72-ac9b-e8f8f4e0c479 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:38.466990 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c63f4ede-1744-4f72-ac9b-e8f8f4e0c479 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:38.467491 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c63f4ede-1744-4f72-ac9b-e8f8f4e0c479 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:38.467916 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c63f4ede-1744-4f72-ac9b-e8f8f4e0c479 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:38.547721 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ef645fc2-eec0-4ebb-9f02-57320d3e2907 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:38.549204 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ef645fc2-eec0-4ebb-9f02-57320d3e2907 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:38.555426 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef645fc2-eec0-4ebb-9f02-57320d3e2907 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:38.555916 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef645fc2-eec0-4ebb-9f02-57320d3e2907 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:38.556353 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef645fc2-eec0-4ebb-9f02-57320d3e2907 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:38.557084 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef645fc2-eec0-4ebb-9f02-57320d3e2907 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:38.557530 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef645fc2-eec0-4ebb-9f02-57320d3e2907 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:38.558026 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef645fc2-eec0-4ebb-9f02-57320d3e2907 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:38.617779 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c63f4ede-1744-4f72-ac9b-e8f8f4e0c479 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:38.625750 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c63f4ede-1744-4f72-ac9b-e8f8f4e0c479 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1318 microversion: 2.1 time: 0.174073 Sep 06 21:18:38.626325 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 302/607] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:38 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:18:38.693107 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ef645fc2-eec0-4ebb-9f02-57320d3e2907 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:38.701942 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ef645fc2-eec0-4ebb-9f02-57320d3e2907 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:38.703512 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ef645fc2-eec0-4ebb-9f02-57320d3e2907 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:38.704860 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ef645fc2-eec0-4ebb-9f02-57320d3e2907 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1723 microversion: 2.20 time: 0.161078 Sep 06 21:18:38.705486 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 306/608] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:38 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:18:39.477552 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-57d432c6-e1f7-4145-bef8-6336d55c787f tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:39.479020 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-57d432c6-e1f7-4145-bef8-6336d55c787f tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:39.486012 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57d432c6-e1f7-4145-bef8-6336d55c787f tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:39.486493 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57d432c6-e1f7-4145-bef8-6336d55c787f tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:39.486920 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57d432c6-e1f7-4145-bef8-6336d55c787f tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:39.487597 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57d432c6-e1f7-4145-bef8-6336d55c787f tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:39.488264 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57d432c6-e1f7-4145-bef8-6336d55c787f tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:39.488528 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57d432c6-e1f7-4145-bef8-6336d55c787f tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:39.629797 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-57d432c6-e1f7-4145-bef8-6336d55c787f tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:39.637794 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-57d432c6-e1f7-4145-bef8-6336d55c787f tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1260 microversion: 2.1 time: 0.164414 Sep 06 21:18:39.638365 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 303/609] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:39 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:39.649643 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2a5ed07f-0242-468a-b430-d4efab24d604 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:39.650315 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2a5ed07f-0242-468a-b430-d4efab24d604 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:39.660802 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a5ed07f-0242-468a-b430-d4efab24d604 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:39.661699 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a5ed07f-0242-468a-b430-d4efab24d604 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:39.662798 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a5ed07f-0242-468a-b430-d4efab24d604 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:39.663562 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a5ed07f-0242-468a-b430-d4efab24d604 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:39.664445 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a5ed07f-0242-468a-b430-d4efab24d604 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:39.665284 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a5ed07f-0242-468a-b430-d4efab24d604 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:39.732447 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3884d6ab-9643-41ef-bc9e-2fbcf7916014 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:39.733113 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3884d6ab-9643-41ef-bc9e-2fbcf7916014 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:39.740722 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3884d6ab-9643-41ef-bc9e-2fbcf7916014 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:39.741201 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3884d6ab-9643-41ef-bc9e-2fbcf7916014 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:39.741624 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3884d6ab-9643-41ef-bc9e-2fbcf7916014 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:39.742348 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3884d6ab-9643-41ef-bc9e-2fbcf7916014 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:39.742819 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3884d6ab-9643-41ef-bc9e-2fbcf7916014 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:39.743227 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3884d6ab-9643-41ef-bc9e-2fbcf7916014 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:39.807851 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2a5ed07f-0242-468a-b430-d4efab24d604 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:39.815938 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2a5ed07f-0242-468a-b430-d4efab24d604 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1318 microversion: 2.1 time: 0.170254 Sep 06 21:18:39.816626 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 307/610] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:39 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:39.878181 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3884d6ab-9643-41ef-bc9e-2fbcf7916014 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:39.888984 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3884d6ab-9643-41ef-bc9e-2fbcf7916014 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:39.890336 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3884d6ab-9643-41ef-bc9e-2fbcf7916014 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:39.891500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3884d6ab-9643-41ef-bc9e-2fbcf7916014 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1723 microversion: 2.20 time: 0.164451 Sep 06 21:18:39.892052 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 304/611] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:39 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:18:40.667427 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-79664afe-dc80-4319-89d2-b7d48bc626d1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:40.668202 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-79664afe-dc80-4319-89d2-b7d48bc626d1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:40.670468 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:18:40.677230 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79664afe-dc80-4319-89d2-b7d48bc626d1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:40.677718 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79664afe-dc80-4319-89d2-b7d48bc626d1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:40.678154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79664afe-dc80-4319-89d2-b7d48bc626d1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:40.678858 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79664afe-dc80-4319-89d2-b7d48bc626d1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:40.679308 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79664afe-dc80-4319-89d2-b7d48bc626d1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:40.679726 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79664afe-dc80-4319-89d2-b7d48bc626d1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:40.815590 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-79664afe-dc80-4319-89d2-b7d48bc626d1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:40.825750 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-79664afe-dc80-4319-89d2-b7d48bc626d1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1260 microversion: 2.1 time: 0.162083 Sep 06 21:18:40.826348 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 308/612] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:40 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:40.840767 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a636d772-3e0a-45a2-bc56-c1810a354c2d tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:40.841407 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a636d772-3e0a-45a2-bc56-c1810a354c2d tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:40.844430 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:18:40.845169 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:18:40.849474 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a636d772-3e0a-45a2-bc56-c1810a354c2d tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:40.849952 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a636d772-3e0a-45a2-bc56-c1810a354c2d tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:40.850382 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a636d772-3e0a-45a2-bc56-c1810a354c2d tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:40.851080 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a636d772-3e0a-45a2-bc56-c1810a354c2d tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:40.851522 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a636d772-3e0a-45a2-bc56-c1810a354c2d tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:40.851936 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a636d772-3e0a-45a2-bc56-c1810a354c2d tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:40.917453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-baf204c8-fa75-44b3-9a70-4f386bbaa7ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:40.918199 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-baf204c8-fa75-44b3-9a70-4f386bbaa7ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:40.926716 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-baf204c8-fa75-44b3-9a70-4f386bbaa7ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:40.927394 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-baf204c8-fa75-44b3-9a70-4f386bbaa7ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:40.927826 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-baf204c8-fa75-44b3-9a70-4f386bbaa7ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:40.928697 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-baf204c8-fa75-44b3-9a70-4f386bbaa7ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:40.929228 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-baf204c8-fa75-44b3-9a70-4f386bbaa7ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:40.929730 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-baf204c8-fa75-44b3-9a70-4f386bbaa7ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:41.005057 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a636d772-3e0a-45a2-bc56-c1810a354c2d tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:41.015397 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a636d772-3e0a-45a2-bc56-c1810a354c2d tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1318 microversion: 2.1 time: 0.179750 Sep 06 21:18:41.020833 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 305/613] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:40 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:41.081896 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-baf204c8-fa75-44b3-9a70-4f386bbaa7ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:41.090606 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-baf204c8-fa75-44b3-9a70-4f386bbaa7ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:41.092142 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-baf204c8-fa75-44b3-9a70-4f386bbaa7ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:41.093542 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-baf204c8-fa75-44b3-9a70-4f386bbaa7ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1723 microversion: 2.20 time: 0.180234 Sep 06 21:18:41.094488 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 309/614] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:40 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:18:41.097596 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-4c9f9980-5fbd-4151-9ffa-06790f3b15ed req-6c7ad667-933e-42cd-9033-1a6ff8f559fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0652742c-8554-4c35-89cd-8ff0fb44659f", "name": "network-vif-plugged", "status": "completed", "tag": "d7f4717c-96be-4a44-bf93-cbe0186339a1"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:18:41.116443 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4c9f9980-5fbd-4151-9ffa-06790f3b15ed req-6c7ad667-933e-42cd-9033-1a6ff8f559fa service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:41.117249 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4c9f9980-5fbd-4151-9ffa-06790f3b15ed req-6c7ad667-933e-42cd-9033-1a6ff8f559fa service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:41.117953 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4c9f9980-5fbd-4151-9ffa-06790f3b15ed req-6c7ad667-933e-42cd-9033-1a6ff8f559fa service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:41.140840 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-4c9f9980-5fbd-4151-9ffa-06790f3b15ed req-6c7ad667-933e-42cd-9033-1a6ff8f559fa service nova] Creating event network-vif-plugged:d7f4717c-96be-4a44-bf93-cbe0186339a1 for instance 0652742c-8554-4c35-89cd-8ff0fb44659f on hv-cinder-74915 Sep 06 21:18:41.149907 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-4c9f9980-5fbd-4151-9ffa-06790f3b15ed req-6c7ad667-933e-42cd-9033-1a6ff8f559fa service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058376 Sep 06 21:18:41.151051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 306/615] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 21:18:41.853015 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fa2631c2-93c1-4fef-a09c-80fb2d151e60 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:41.853577 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fa2631c2-93c1-4fef-a09c-80fb2d151e60 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:41.860954 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa2631c2-93c1-4fef-a09c-80fb2d151e60 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:41.861422 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa2631c2-93c1-4fef-a09c-80fb2d151e60 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:41.861849 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa2631c2-93c1-4fef-a09c-80fb2d151e60 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:41.862737 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa2631c2-93c1-4fef-a09c-80fb2d151e60 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:41.863780 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa2631c2-93c1-4fef-a09c-80fb2d151e60 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:41.864438 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa2631c2-93c1-4fef-a09c-80fb2d151e60 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:41.869973 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:18:42.039015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5eeed2e2-5ce7-4d20-8b8a-98b162991015 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:42.039893 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5eeed2e2-5ce7-4d20-8b8a-98b162991015 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:42.048535 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5eeed2e2-5ce7-4d20-8b8a-98b162991015 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:42.049132 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5eeed2e2-5ce7-4d20-8b8a-98b162991015 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:42.049559 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5eeed2e2-5ce7-4d20-8b8a-98b162991015 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:42.050504 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5eeed2e2-5ce7-4d20-8b8a-98b162991015 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:42.050948 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5eeed2e2-5ce7-4d20-8b8a-98b162991015 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:42.051339 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5eeed2e2-5ce7-4d20-8b8a-98b162991015 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:42.159651 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-fa2631c2-93c1-4fef-a09c-80fb2d151e60 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:42.169448 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fa2631c2-93c1-4fef-a09c-80fb2d151e60 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1260 microversion: 2.1 time: 0.322218 Sep 06 21:18:42.170377 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 310/616] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:41 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1260 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:42.175123 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-77725146-2356-4681-8751-9a66c06bf010 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:42.175725 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-77725146-2356-4681-8751-9a66c06bf010 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:42.182773 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77725146-2356-4681-8751-9a66c06bf010 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:42.183660 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77725146-2356-4681-8751-9a66c06bf010 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:42.184100 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77725146-2356-4681-8751-9a66c06bf010 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:42.184878 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77725146-2356-4681-8751-9a66c06bf010 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:42.185519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77725146-2356-4681-8751-9a66c06bf010 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:42.185942 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77725146-2356-4681-8751-9a66c06bf010 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:42.211687 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5eeed2e2-5ce7-4d20-8b8a-98b162991015 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:42.223634 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5eeed2e2-5ce7-4d20-8b8a-98b162991015 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1318 microversion: 2.1 time: 0.188890 Sep 06 21:18:42.224226 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 307/617] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:42 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:42.340019 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-77725146-2356-4681-8751-9a66c06bf010 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:42.353605 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-77725146-2356-4681-8751-9a66c06bf010 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:42.355242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-77725146-2356-4681-8751-9a66c06bf010 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:42.356455 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-77725146-2356-4681-8751-9a66c06bf010 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1723 microversion: 2.20 time: 0.185502 Sep 06 21:18:42.357049 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 311/618] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:42 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:18:43.207798 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fa122d96-285d-43b9-bd55-54b93a9d985d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:43.208636 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fa122d96-285d-43b9-bd55-54b93a9d985d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:43.215792 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa122d96-285d-43b9-bd55-54b93a9d985d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:43.216275 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa122d96-285d-43b9-bd55-54b93a9d985d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:43.216736 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa122d96-285d-43b9-bd55-54b93a9d985d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:43.217456 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa122d96-285d-43b9-bd55-54b93a9d985d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:43.217901 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa122d96-285d-43b9-bd55-54b93a9d985d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:43.218311 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa122d96-285d-43b9-bd55-54b93a9d985d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:43.246913 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-23a51880-ea7e-42a9-b419-538e7e158d61 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:43.247872 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-23a51880-ea7e-42a9-b419-538e7e158d61 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:43.255202 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23a51880-ea7e-42a9-b419-538e7e158d61 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:43.255695 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23a51880-ea7e-42a9-b419-538e7e158d61 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:43.257227 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23a51880-ea7e-42a9-b419-538e7e158d61 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:43.258438 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23a51880-ea7e-42a9-b419-538e7e158d61 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:43.258653 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23a51880-ea7e-42a9-b419-538e7e158d61 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:43.259258 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23a51880-ea7e-42a9-b419-538e7e158d61 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:43.429647 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-23a51880-ea7e-42a9-b419-538e7e158d61 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:43.439155 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-23a51880-ea7e-42a9-b419-538e7e158d61 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1318 microversion: 2.1 time: 0.196409 Sep 06 21:18:43.440387 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 312/619] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:43 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:43.459867 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9ada6751-f0e9-4777-ad54-5dc5a7233c8f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:43.460492 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9ada6751-f0e9-4777-ad54-5dc5a7233c8f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:43.481039 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ada6751-f0e9-4777-ad54-5dc5a7233c8f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:43.482977 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ada6751-f0e9-4777-ad54-5dc5a7233c8f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:43.482977 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ada6751-f0e9-4777-ad54-5dc5a7233c8f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:43.487388 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ada6751-f0e9-4777-ad54-5dc5a7233c8f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:43.488172 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ada6751-f0e9-4777-ad54-5dc5a7233c8f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:43.488805 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ada6751-f0e9-4777-ad54-5dc5a7233c8f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:43.537651 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fa122d96-285d-43b9-bd55-54b93a9d985d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:43.555965 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fa122d96-285d-43b9-bd55-54b93a9d985d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1260 microversion: 2.1 time: 0.351952 Sep 06 21:18:43.558992 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 308/620] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:43 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1260 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:18:43.755317 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9ada6751-f0e9-4777-ad54-5dc5a7233c8f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:43.764242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9ada6751-f0e9-4777-ad54-5dc5a7233c8f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:43.765736 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9ada6751-f0e9-4777-ad54-5dc5a7233c8f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:43.766906 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9ada6751-f0e9-4777-ad54-5dc5a7233c8f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1744 microversion: 2.20 time: 0.325281 Sep 06 21:18:43.767431 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 313/621] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:43 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1744 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:18:44.014209 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dd21022c-b2e6-4a32-9cee-b7984ed981f2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:18:44.020997 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd21022c-b2e6-4a32-9cee-b7984ed981f2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:44.021668 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd21022c-b2e6-4a32-9cee-b7984ed981f2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:44.022100 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd21022c-b2e6-4a32-9cee-b7984ed981f2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:44.081702 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dd21022c-b2e6-4a32-9cee-b7984ed981f2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Going to try to stop instance {{(pid=120720) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 06 21:18:44.127435 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dd21022c-b2e6-4a32-9cee-b7984ed981f2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "POST /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f/action" status: 202 len: 0 microversion: 2.1 time: 0.117017 Sep 06 21:18:44.127950 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 309/622] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Sep 6 21:18:44 2022] POST /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:18:44.136603 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ec2d8cda-1d8a-4f08-a411-22bf4d92914b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:44.137233 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ec2d8cda-1d8a-4f08-a411-22bf4d92914b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:44.143887 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec2d8cda-1d8a-4f08-a411-22bf4d92914b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:44.144368 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec2d8cda-1d8a-4f08-a411-22bf4d92914b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:44.144841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec2d8cda-1d8a-4f08-a411-22bf4d92914b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:44.145540 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec2d8cda-1d8a-4f08-a411-22bf4d92914b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:44.145991 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec2d8cda-1d8a-4f08-a411-22bf4d92914b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:44.146409 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec2d8cda-1d8a-4f08-a411-22bf4d92914b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:44.291893 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ec2d8cda-1d8a-4f08-a411-22bf4d92914b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:44.301265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ec2d8cda-1d8a-4f08-a411-22bf4d92914b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1722 microversion: 2.1 time: 0.168872 Sep 06 21:18:44.301850 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 314/623] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:44 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:44.465040 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7e3f74cb-f77f-4f11-99ff-d492d0d6640a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:44.465667 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7e3f74cb-f77f-4f11-99ff-d492d0d6640a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:44.472233 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e3f74cb-f77f-4f11-99ff-d492d0d6640a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:44.472793 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e3f74cb-f77f-4f11-99ff-d492d0d6640a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:44.473226 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e3f74cb-f77f-4f11-99ff-d492d0d6640a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:44.473945 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e3f74cb-f77f-4f11-99ff-d492d0d6640a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:44.474378 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e3f74cb-f77f-4f11-99ff-d492d0d6640a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:44.474803 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e3f74cb-f77f-4f11-99ff-d492d0d6640a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:44.579640 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-87083d85-7524-45b7-a5ed-a81129332202 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:44.580243 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-87083d85-7524-45b7-a5ed-a81129332202 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:44.586792 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87083d85-7524-45b7-a5ed-a81129332202 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:44.587681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87083d85-7524-45b7-a5ed-a81129332202 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:44.587681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87083d85-7524-45b7-a5ed-a81129332202 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:44.588418 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87083d85-7524-45b7-a5ed-a81129332202 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:44.588884 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87083d85-7524-45b7-a5ed-a81129332202 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:44.589301 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87083d85-7524-45b7-a5ed-a81129332202 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:44.624615 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7e3f74cb-f77f-4f11-99ff-d492d0d6640a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:44.628291 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:18:44.638752 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7e3f74cb-f77f-4f11-99ff-d492d0d6640a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1318 microversion: 2.1 time: 0.178510 Sep 06 21:18:44.640794 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 310/624] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:44 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:44.763478 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-87083d85-7524-45b7-a5ed-a81129332202 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:44.771569 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-87083d85-7524-45b7-a5ed-a81129332202 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1260 microversion: 2.1 time: 0.195724 Sep 06 21:18:44.772146 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 315/625] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:44 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1260 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:44.793493 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4c40ce91-5f47-40d0-ba87-ee000ce22c6c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:44.794103 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4c40ce91-5f47-40d0-ba87-ee000ce22c6c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:44.801754 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c40ce91-5f47-40d0-ba87-ee000ce22c6c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:44.802238 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c40ce91-5f47-40d0-ba87-ee000ce22c6c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:44.802673 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c40ce91-5f47-40d0-ba87-ee000ce22c6c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:44.803406 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c40ce91-5f47-40d0-ba87-ee000ce22c6c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:44.803876 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c40ce91-5f47-40d0-ba87-ee000ce22c6c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:44.804295 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c40ce91-5f47-40d0-ba87-ee000ce22c6c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:44.942446 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4c40ce91-5f47-40d0-ba87-ee000ce22c6c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:44.951144 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4c40ce91-5f47-40d0-ba87-ee000ce22c6c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:44.952555 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4c40ce91-5f47-40d0-ba87-ee000ce22c6c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:44.953745 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4c40ce91-5f47-40d0-ba87-ee000ce22c6c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1744 microversion: 2.20 time: 0.164847 Sep 06 21:18:44.954354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 311/626] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:44 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:18:45.329201 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fd8c910a-9527-4536-80cc-896596771202 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:45.330204 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fd8c910a-9527-4536-80cc-896596771202 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:45.340781 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd8c910a-9527-4536-80cc-896596771202 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:45.341266 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd8c910a-9527-4536-80cc-896596771202 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:45.341705 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd8c910a-9527-4536-80cc-896596771202 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:45.342432 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd8c910a-9527-4536-80cc-896596771202 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:45.343026 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd8c910a-9527-4536-80cc-896596771202 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:45.343459 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd8c910a-9527-4536-80cc-896596771202 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:45.481856 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-fd8c910a-9527-4536-80cc-896596771202 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:45.494756 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fd8c910a-9527-4536-80cc-896596771202 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1722 microversion: 2.1 time: 0.171945 Sep 06 21:18:45.495575 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 316/627] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:45 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:45.664559 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5329d987-3e66-46b5-b160-47f38873f64f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:45.665366 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5329d987-3e66-46b5-b160-47f38873f64f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:45.673518 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5329d987-3e66-46b5-b160-47f38873f64f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:45.673998 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5329d987-3e66-46b5-b160-47f38873f64f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:45.674433 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5329d987-3e66-46b5-b160-47f38873f64f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:45.675132 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5329d987-3e66-46b5-b160-47f38873f64f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:45.675582 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5329d987-3e66-46b5-b160-47f38873f64f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:45.676003 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5329d987-3e66-46b5-b160-47f38873f64f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:45.795759 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-23bfa23c-b30b-4a4d-9123-14b9f0c5d54e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:45.796408 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-23bfa23c-b30b-4a4d-9123-14b9f0c5d54e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:45.803023 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23bfa23c-b30b-4a4d-9123-14b9f0c5d54e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:45.803494 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23bfa23c-b30b-4a4d-9123-14b9f0c5d54e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:45.803922 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23bfa23c-b30b-4a4d-9123-14b9f0c5d54e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:45.804619 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23bfa23c-b30b-4a4d-9123-14b9f0c5d54e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:45.805091 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23bfa23c-b30b-4a4d-9123-14b9f0c5d54e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:45.805511 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23bfa23c-b30b-4a4d-9123-14b9f0c5d54e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:45.816678 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5329d987-3e66-46b5-b160-47f38873f64f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:45.824884 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5329d987-3e66-46b5-b160-47f38873f64f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1318 microversion: 2.1 time: 0.164499 Sep 06 21:18:45.825516 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 312/628] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:45 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:45.945591 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-23bfa23c-b30b-4a4d-9123-14b9f0c5d54e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:45.953936 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-23bfa23c-b30b-4a4d-9123-14b9f0c5d54e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1260 microversion: 2.1 time: 0.162798 Sep 06 21:18:45.954511 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 317/629] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:45 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:18:45.982120 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8e6c64e5-72a1-4eab-8860-d71ca11110eb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:45.982732 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8e6c64e5-72a1-4eab-8860-d71ca11110eb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:45.989800 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e6c64e5-72a1-4eab-8860-d71ca11110eb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:45.990287 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e6c64e5-72a1-4eab-8860-d71ca11110eb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:45.990720 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e6c64e5-72a1-4eab-8860-d71ca11110eb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:45.991427 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e6c64e5-72a1-4eab-8860-d71ca11110eb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:45.991872 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e6c64e5-72a1-4eab-8860-d71ca11110eb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:45.992295 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e6c64e5-72a1-4eab-8860-d71ca11110eb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:46.138998 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8e6c64e5-72a1-4eab-8860-d71ca11110eb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:46.152501 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8e6c64e5-72a1-4eab-8860-d71ca11110eb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:46.153975 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8e6c64e5-72a1-4eab-8860-d71ca11110eb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:46.155130 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8e6c64e5-72a1-4eab-8860-d71ca11110eb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1744 microversion: 2.20 time: 0.179258 Sep 06 21:18:46.155691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 313/630] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:45 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1744 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:18:46.522920 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f7c9125f-054d-48dc-a84f-ff7fa271ef02 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:46.523881 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f7c9125f-054d-48dc-a84f-ff7fa271ef02 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:46.532924 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7c9125f-054d-48dc-a84f-ff7fa271ef02 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:46.533405 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7c9125f-054d-48dc-a84f-ff7fa271ef02 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:46.533837 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7c9125f-054d-48dc-a84f-ff7fa271ef02 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:46.534537 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7c9125f-054d-48dc-a84f-ff7fa271ef02 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:46.534983 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7c9125f-054d-48dc-a84f-ff7fa271ef02 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:46.535403 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f7c9125f-054d-48dc-a84f-ff7fa271ef02 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:46.675288 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f7c9125f-054d-48dc-a84f-ff7fa271ef02 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:46.690137 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f7c9125f-054d-48dc-a84f-ff7fa271ef02 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1722 microversion: 2.1 time: 0.173598 Sep 06 21:18:46.690893 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 318/631] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:46 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:46.851673 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-84a910db-548d-4a01-88b4-3e761daf5cdb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:46.852637 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-84a910db-548d-4a01-88b4-3e761daf5cdb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:46.864075 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84a910db-548d-4a01-88b4-3e761daf5cdb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:46.864936 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84a910db-548d-4a01-88b4-3e761daf5cdb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:46.865641 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84a910db-548d-4a01-88b4-3e761daf5cdb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:46.866762 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84a910db-548d-4a01-88b4-3e761daf5cdb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:46.867495 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84a910db-548d-4a01-88b4-3e761daf5cdb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:46.868180 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84a910db-548d-4a01-88b4-3e761daf5cdb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:46.977492 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a48b0091-dae7-4021-a052-9d601a609e47 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:46.978111 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a48b0091-dae7-4021-a052-9d601a609e47 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:46.985998 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a48b0091-dae7-4021-a052-9d601a609e47 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:46.986499 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a48b0091-dae7-4021-a052-9d601a609e47 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:46.987825 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a48b0091-dae7-4021-a052-9d601a609e47 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:46.988553 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a48b0091-dae7-4021-a052-9d601a609e47 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:46.989302 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a48b0091-dae7-4021-a052-9d601a609e47 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:46.989605 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a48b0091-dae7-4021-a052-9d601a609e47 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:47.030517 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-84a910db-548d-4a01-88b4-3e761daf5cdb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:47.040114 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-84a910db-548d-4a01-88b4-3e761daf5cdb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1318 microversion: 2.1 time: 0.194945 Sep 06 21:18:47.040685 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 314/632] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:46 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:47.065007 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-d7c318e3-4183-4815-a8cc-39932a040369 req-8dec3ff2-7f13-4b1c-8bda-843bee64791f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fea1aa0-032e-454d-9358-98a81cd5d650", "name": "network-vif-plugged", "status": "completed", "tag": "7ea4447f-6e97-421a-ae16-09790d6651e8"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:18:47.075264 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d7c318e3-4183-4815-a8cc-39932a040369 req-8dec3ff2-7f13-4b1c-8bda-843bee64791f service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:47.075782 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d7c318e3-4183-4815-a8cc-39932a040369 req-8dec3ff2-7f13-4b1c-8bda-843bee64791f service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:47.076244 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d7c318e3-4183-4815-a8cc-39932a040369 req-8dec3ff2-7f13-4b1c-8bda-843bee64791f service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:47.087982 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-d7c318e3-4183-4815-a8cc-39932a040369 req-8dec3ff2-7f13-4b1c-8bda-843bee64791f service nova] Creating event network-vif-plugged:7ea4447f-6e97-421a-ae16-09790d6651e8 for instance 8fea1aa0-032e-454d-9358-98a81cd5d650 on hv-cinder-74915 Sep 06 21:18:47.093165 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-d7c318e3-4183-4815-a8cc-39932a040369 req-8dec3ff2-7f13-4b1c-8bda-843bee64791f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032733 Sep 06 21:18:47.094607 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 315/633] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 21:18:47.148625 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a48b0091-dae7-4021-a052-9d601a609e47 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:47.157306 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a48b0091-dae7-4021-a052-9d601a609e47 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1260 microversion: 2.1 time: 0.183138 Sep 06 21:18:47.161424 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 319/634] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:46 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:18:47.181320 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3a55bf57-1b40-47cd-902b-051b62e0d6d7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:47.182055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3a55bf57-1b40-47cd-902b-051b62e0d6d7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:47.188719 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a55bf57-1b40-47cd-902b-051b62e0d6d7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:47.189231 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a55bf57-1b40-47cd-902b-051b62e0d6d7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:47.189596 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a55bf57-1b40-47cd-902b-051b62e0d6d7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:47.190290 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a55bf57-1b40-47cd-902b-051b62e0d6d7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:47.190746 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a55bf57-1b40-47cd-902b-051b62e0d6d7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:47.191182 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a55bf57-1b40-47cd-902b-051b62e0d6d7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:47.321382 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3a55bf57-1b40-47cd-902b-051b62e0d6d7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:47.330685 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3a55bf57-1b40-47cd-902b-051b62e0d6d7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:47.332117 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3a55bf57-1b40-47cd-902b-051b62e0d6d7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:47.333323 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3a55bf57-1b40-47cd-902b-051b62e0d6d7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1744 microversion: 2.20 time: 0.156397 Sep 06 21:18:47.333849 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 316/635] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:47 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:18:47.718295 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-302706f8-10a1-4851-940c-7898b55fe35f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:47.718878 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-302706f8-10a1-4851-940c-7898b55fe35f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:47.725781 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-302706f8-10a1-4851-940c-7898b55fe35f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:47.726266 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-302706f8-10a1-4851-940c-7898b55fe35f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:47.726704 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-302706f8-10a1-4851-940c-7898b55fe35f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:47.727540 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-302706f8-10a1-4851-940c-7898b55fe35f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:47.727993 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-302706f8-10a1-4851-940c-7898b55fe35f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:47.728418 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-302706f8-10a1-4851-940c-7898b55fe35f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:47.872085 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-302706f8-10a1-4851-940c-7898b55fe35f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:47.880927 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-302706f8-10a1-4851-940c-7898b55fe35f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1722 microversion: 2.1 time: 0.166695 Sep 06 21:18:47.881557 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 320/636] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:47 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:48.067787 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e6fcf701-ae68-4be2-aa50-3b2c72dded27 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:48.068803 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e6fcf701-ae68-4be2-aa50-3b2c72dded27 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:48.078580 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6fcf701-ae68-4be2-aa50-3b2c72dded27 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:48.079070 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6fcf701-ae68-4be2-aa50-3b2c72dded27 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:48.079504 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6fcf701-ae68-4be2-aa50-3b2c72dded27 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:48.080217 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6fcf701-ae68-4be2-aa50-3b2c72dded27 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:48.080696 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6fcf701-ae68-4be2-aa50-3b2c72dded27 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:48.081120 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6fcf701-ae68-4be2-aa50-3b2c72dded27 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:48.181621 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-af6a7b43-170a-42e8-abb2-5380aa39055a tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:48.182225 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-af6a7b43-170a-42e8-abb2-5380aa39055a tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:48.188547 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af6a7b43-170a-42e8-abb2-5380aa39055a tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:48.189070 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af6a7b43-170a-42e8-abb2-5380aa39055a tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:48.189503 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af6a7b43-170a-42e8-abb2-5380aa39055a tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:48.190200 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af6a7b43-170a-42e8-abb2-5380aa39055a tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:48.190647 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af6a7b43-170a-42e8-abb2-5380aa39055a tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:48.191066 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af6a7b43-170a-42e8-abb2-5380aa39055a tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:48.225081 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e6fcf701-ae68-4be2-aa50-3b2c72dded27 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:48.233245 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e6fcf701-ae68-4be2-aa50-3b2c72dded27 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1507 microversion: 2.1 time: 0.172209 Sep 06 21:18:48.234051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 317/637] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:48 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:48.256302 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2d278b1d-dd81-42a0-bd60-3bf5adcf5c45 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a5b9f50-5423-4337-a509-6ec4e915a400", "device": "/dev/sdb"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:18:48.258834 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2d278b1d-dd81-42a0-bd60-3bf5adcf5c45 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:48.265448 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d278b1d-dd81-42a0-bd60-3bf5adcf5c45 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:48.265930 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d278b1d-dd81-42a0-bd60-3bf5adcf5c45 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:48.266373 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d278b1d-dd81-42a0-bd60-3bf5adcf5c45 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:48.267064 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d278b1d-dd81-42a0-bd60-3bf5adcf5c45 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:48.267516 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d278b1d-dd81-42a0-bd60-3bf5adcf5c45 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:48.267941 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d278b1d-dd81-42a0-bd60-3bf5adcf5c45 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:48.326506 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-af6a7b43-170a-42e8-abb2-5380aa39055a tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:48.334357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-af6a7b43-170a-42e8-abb2-5380aa39055a tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1260 microversion: 2.1 time: 0.156631 Sep 06 21:18:48.334927 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 321/638] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:48 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:48.359099 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-35865da8-0348-4f5b-a248-32dee0405059 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:48.359706 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-35865da8-0348-4f5b-a248-32dee0405059 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:48.365826 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35865da8-0348-4f5b-a248-32dee0405059 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:48.366308 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35865da8-0348-4f5b-a248-32dee0405059 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:48.366743 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35865da8-0348-4f5b-a248-32dee0405059 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:48.367439 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35865da8-0348-4f5b-a248-32dee0405059 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:48.367891 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35865da8-0348-4f5b-a248-32dee0405059 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:48.368310 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35865da8-0348-4f5b-a248-32dee0405059 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:48.523803 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-35865da8-0348-4f5b-a248-32dee0405059 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:48.533355 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-35865da8-0348-4f5b-a248-32dee0405059 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:48.534946 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-35865da8-0348-4f5b-a248-32dee0405059 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:48.535924 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-35865da8-0348-4f5b-a248-32dee0405059 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1744 microversion: 2.20 time: 0.180804 Sep 06 21:18:48.536480 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 322/639] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:48 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1744 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 21:18:48.605152 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2d278b1d-dd81-42a0-bd60-3bf5adcf5c45 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "POST /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.352991 Sep 06 21:18:48.605812 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 318/640] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Sep 6 21:18:48 2022] POST /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f/os-volume_attachments => generated 194 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:18:48.906483 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-84402d13-a5fb-410e-b846-9be9dcbdf7e6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:48.907171 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-84402d13-a5fb-410e-b846-9be9dcbdf7e6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:48.916326 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-84402d13-a5fb-410e-b846-9be9dcbdf7e6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:48.916852 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-84402d13-a5fb-410e-b846-9be9dcbdf7e6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:48.917316 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-84402d13-a5fb-410e-b846-9be9dcbdf7e6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:48.918031 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-84402d13-a5fb-410e-b846-9be9dcbdf7e6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:48.918617 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-84402d13-a5fb-410e-b846-9be9dcbdf7e6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:48.919039 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-84402d13-a5fb-410e-b846-9be9dcbdf7e6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:49.057785 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-84402d13-a5fb-410e-b846-9be9dcbdf7e6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:49.066720 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-84402d13-a5fb-410e-b846-9be9dcbdf7e6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1722 microversion: 2.1 time: 0.166543 Sep 06 21:18:49.067306 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 323/641] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:48 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:49.115251 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-0aeef2b9-2bd6-4100-9d9e-ce54c61c2738 req-8529c100-a1e9-4d68-865e-831457f39260 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "340de6d7-883f-4c26-89b1-4f8536aa09e8", "name": "network-vif-plugged", "status": "completed", "tag": "e03713ad-150d-4e1c-af49-98c4a6fe49fe"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:18:49.127983 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0aeef2b9-2bd6-4100-9d9e-ce54c61c2738 req-8529c100-a1e9-4d68-865e-831457f39260 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:49.128453 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0aeef2b9-2bd6-4100-9d9e-ce54c61c2738 req-8529c100-a1e9-4d68-865e-831457f39260 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:49.128913 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0aeef2b9-2bd6-4100-9d9e-ce54c61c2738 req-8529c100-a1e9-4d68-865e-831457f39260 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:49.140156 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-0aeef2b9-2bd6-4100-9d9e-ce54c61c2738 req-8529c100-a1e9-4d68-865e-831457f39260 service nova] Creating event network-vif-plugged:e03713ad-150d-4e1c-af49-98c4a6fe49fe for instance 340de6d7-883f-4c26-89b1-4f8536aa09e8 on hv-cinder-74915 Sep 06 21:18:49.145069 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-0aeef2b9-2bd6-4100-9d9e-ce54c61c2738 req-8529c100-a1e9-4d68-865e-831457f39260 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037359 Sep 06 21:18:49.145638 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 319/642] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:18:49.358719 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-63875741-469e-4c94-b3b5-d8108786332f tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:49.359220 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-63875741-469e-4c94-b3b5-d8108786332f tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:49.365728 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63875741-469e-4c94-b3b5-d8108786332f tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:49.366212 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63875741-469e-4c94-b3b5-d8108786332f tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:49.366644 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63875741-469e-4c94-b3b5-d8108786332f tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:49.367342 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63875741-469e-4c94-b3b5-d8108786332f tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:49.367796 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63875741-469e-4c94-b3b5-d8108786332f tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:49.368225 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-63875741-469e-4c94-b3b5-d8108786332f tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:49.510486 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-63875741-469e-4c94-b3b5-d8108786332f tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:49.519084 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-63875741-469e-4c94-b3b5-d8108786332f tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1260 microversion: 2.1 time: 0.164693 Sep 06 21:18:49.520024 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 324/643] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:49 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:49.563720 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8079501b-f95a-4a43-a1e9-80c838e3f168 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:49.564876 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8079501b-f95a-4a43-a1e9-80c838e3f168 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:49.571916 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8079501b-f95a-4a43-a1e9-80c838e3f168 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:49.572386 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8079501b-f95a-4a43-a1e9-80c838e3f168 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:49.573095 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8079501b-f95a-4a43-a1e9-80c838e3f168 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:49.573870 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8079501b-f95a-4a43-a1e9-80c838e3f168 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:49.574308 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8079501b-f95a-4a43-a1e9-80c838e3f168 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:49.574999 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8079501b-f95a-4a43-a1e9-80c838e3f168 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:49.727556 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8079501b-f95a-4a43-a1e9-80c838e3f168 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:49.736464 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8079501b-f95a-4a43-a1e9-80c838e3f168 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:49.737947 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8079501b-f95a-4a43-a1e9-80c838e3f168 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:49.739103 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8079501b-f95a-4a43-a1e9-80c838e3f168 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1744 microversion: 2.20 time: 0.180843 Sep 06 21:18:49.739875 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 320/644] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:49 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1744 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:18:50.103374 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ed26c688-8bc3-4b55-b0fe-024b394922d3 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:50.104325 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ed26c688-8bc3-4b55-b0fe-024b394922d3 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:50.112333 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed26c688-8bc3-4b55-b0fe-024b394922d3 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:50.112840 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed26c688-8bc3-4b55-b0fe-024b394922d3 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:50.113267 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed26c688-8bc3-4b55-b0fe-024b394922d3 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:50.113966 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed26c688-8bc3-4b55-b0fe-024b394922d3 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:50.114407 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed26c688-8bc3-4b55-b0fe-024b394922d3 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:50.114824 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed26c688-8bc3-4b55-b0fe-024b394922d3 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:50.273383 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ed26c688-8bc3-4b55-b0fe-024b394922d3 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:50.287083 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ed26c688-8bc3-4b55-b0fe-024b394922d3 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1722 microversion: 2.1 time: 0.189976 Sep 06 21:18:50.287859 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 325/645] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:50 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:50.607105 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1b4289fa-2ac7-4893-90a5-481c646b0c3b tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:50.607757 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1b4289fa-2ac7-4893-90a5-481c646b0c3b tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:50.614809 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b4289fa-2ac7-4893-90a5-481c646b0c3b tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:50.615312 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b4289fa-2ac7-4893-90a5-481c646b0c3b tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:50.615746 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b4289fa-2ac7-4893-90a5-481c646b0c3b tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:50.616444 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b4289fa-2ac7-4893-90a5-481c646b0c3b tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:50.616927 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b4289fa-2ac7-4893-90a5-481c646b0c3b tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:50.617349 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b4289fa-2ac7-4893-90a5-481c646b0c3b tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:50.765190 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b354e5ea-1471-435c-9f88-4c474879458e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:50.766543 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b354e5ea-1471-435c-9f88-4c474879458e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:50.767627 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1b4289fa-2ac7-4893-90a5-481c646b0c3b tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:50.772714 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b354e5ea-1471-435c-9f88-4c474879458e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:50.773439 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b354e5ea-1471-435c-9f88-4c474879458e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:50.773672 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b354e5ea-1471-435c-9f88-4c474879458e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:50.774581 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b354e5ea-1471-435c-9f88-4c474879458e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:50.775035 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b354e5ea-1471-435c-9f88-4c474879458e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:50.775426 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b354e5ea-1471-435c-9f88-4c474879458e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:50.775812 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1b4289fa-2ac7-4893-90a5-481c646b0c3b tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1260 microversion: 2.1 time: 0.173061 Sep 06 21:18:50.776617 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 321/646] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:50 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:50.910844 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b354e5ea-1471-435c-9f88-4c474879458e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:50.914283 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:18:50.919270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b354e5ea-1471-435c-9f88-4c474879458e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:50.920791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b354e5ea-1471-435c-9f88-4c474879458e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:50.921967 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b354e5ea-1471-435c-9f88-4c474879458e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1744 microversion: 2.20 time: 0.161033 Sep 06 21:18:50.922486 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 326/647] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:50 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:18:51.316598 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-86078284-8b4d-4bdd-9a85-83333442211f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:51.317349 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-86078284-8b4d-4bdd-9a85-83333442211f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:51.325684 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86078284-8b4d-4bdd-9a85-83333442211f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:51.326245 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86078284-8b4d-4bdd-9a85-83333442211f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:51.326753 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86078284-8b4d-4bdd-9a85-83333442211f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:51.327557 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86078284-8b4d-4bdd-9a85-83333442211f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:51.328093 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86078284-8b4d-4bdd-9a85-83333442211f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:51.328627 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86078284-8b4d-4bdd-9a85-83333442211f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:51.476461 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-86078284-8b4d-4bdd-9a85-83333442211f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:51.486716 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-86078284-8b4d-4bdd-9a85-83333442211f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1722 microversion: 2.1 time: 0.174903 Sep 06 21:18:51.487317 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 322/648] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:51 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:51.800593 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6c669385-ec7d-401c-9ec1-9ffa35f36c35 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:51.801221 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6c669385-ec7d-401c-9ec1-9ffa35f36c35 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:51.810112 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c669385-ec7d-401c-9ec1-9ffa35f36c35 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:51.810609 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c669385-ec7d-401c-9ec1-9ffa35f36c35 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:51.811048 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c669385-ec7d-401c-9ec1-9ffa35f36c35 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:51.811752 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c669385-ec7d-401c-9ec1-9ffa35f36c35 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:51.812205 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c669385-ec7d-401c-9ec1-9ffa35f36c35 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:51.812626 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c669385-ec7d-401c-9ec1-9ffa35f36c35 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:51.949217 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ba157f37-a5b4-4e8e-bd97-e896f1848102 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:51.949798 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ba157f37-a5b4-4e8e-bd97-e896f1848102 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:51.956043 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba157f37-a5b4-4e8e-bd97-e896f1848102 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:51.956489 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba157f37-a5b4-4e8e-bd97-e896f1848102 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:51.956988 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba157f37-a5b4-4e8e-bd97-e896f1848102 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:51.957686 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba157f37-a5b4-4e8e-bd97-e896f1848102 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:51.958136 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba157f37-a5b4-4e8e-bd97-e896f1848102 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:51.958539 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba157f37-a5b4-4e8e-bd97-e896f1848102 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:51.964044 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6c669385-ec7d-401c-9ec1-9ffa35f36c35 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:51.972098 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6c669385-ec7d-401c-9ec1-9ffa35f36c35 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1260 microversion: 2.1 time: 0.176465 Sep 06 21:18:51.972646 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 327/649] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:51 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:52.093452 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ba157f37-a5b4-4e8e-bd97-e896f1848102 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:52.101738 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ba157f37-a5b4-4e8e-bd97-e896f1848102 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:52.103182 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ba157f37-a5b4-4e8e-bd97-e896f1848102 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:52.104355 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ba157f37-a5b4-4e8e-bd97-e896f1848102 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1739 microversion: 2.20 time: 0.159615 Sep 06 21:18:52.104980 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 323/650] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:51 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 21:18:52.514918 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bc5c1ad3-210c-41af-b227-765ad6725224 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:52.516207 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bc5c1ad3-210c-41af-b227-765ad6725224 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:52.522854 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc5c1ad3-210c-41af-b227-765ad6725224 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:52.523340 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc5c1ad3-210c-41af-b227-765ad6725224 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:52.523789 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc5c1ad3-210c-41af-b227-765ad6725224 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:52.524484 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc5c1ad3-210c-41af-b227-765ad6725224 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:52.524969 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc5c1ad3-210c-41af-b227-765ad6725224 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:52.525396 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc5c1ad3-210c-41af-b227-765ad6725224 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:52.662403 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-bc5c1ad3-210c-41af-b227-765ad6725224 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:52.671098 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bc5c1ad3-210c-41af-b227-765ad6725224 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1722 microversion: 2.1 time: 0.162604 Sep 06 21:18:52.671640 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 328/651] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:52 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:52.995093 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0478f61a-c292-4dd6-bf6c-74d899f08621 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:52.995702 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0478f61a-c292-4dd6-bf6c-74d899f08621 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:53.002504 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0478f61a-c292-4dd6-bf6c-74d899f08621 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:53.003740 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0478f61a-c292-4dd6-bf6c-74d899f08621 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:53.003740 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0478f61a-c292-4dd6-bf6c-74d899f08621 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:53.004116 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0478f61a-c292-4dd6-bf6c-74d899f08621 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:53.004612 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0478f61a-c292-4dd6-bf6c-74d899f08621 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:53.005089 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0478f61a-c292-4dd6-bf6c-74d899f08621 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:53.130631 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-87d13687-4688-43b8-adc3-7afc096c9d2b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:53.131754 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-87d13687-4688-43b8-adc3-7afc096c9d2b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:53.138425 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87d13687-4688-43b8-adc3-7afc096c9d2b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:53.139472 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87d13687-4688-43b8-adc3-7afc096c9d2b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:53.140066 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87d13687-4688-43b8-adc3-7afc096c9d2b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:53.141289 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87d13687-4688-43b8-adc3-7afc096c9d2b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:53.141992 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87d13687-4688-43b8-adc3-7afc096c9d2b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:53.142949 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-87d13687-4688-43b8-adc3-7afc096c9d2b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:53.143272 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0478f61a-c292-4dd6-bf6c-74d899f08621 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:53.151761 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0478f61a-c292-4dd6-bf6c-74d899f08621 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1443 microversion: 2.1 time: 0.160545 Sep 06 21:18:53.152338 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 324/652] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:52 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1443 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:53.174984 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ba4317d2-97d5-4c09-ade4-19805692b8ad tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:53.175929 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ba4317d2-97d5-4c09-ade4-19805692b8ad tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:53.182176 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba4317d2-97d5-4c09-ade4-19805692b8ad tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:53.182618 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba4317d2-97d5-4c09-ade4-19805692b8ad tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:53.183218 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba4317d2-97d5-4c09-ade4-19805692b8ad tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:53.184082 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba4317d2-97d5-4c09-ade4-19805692b8ad tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:53.184740 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba4317d2-97d5-4c09-ade4-19805692b8ad tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:53.185321 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba4317d2-97d5-4c09-ade4-19805692b8ad tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:53.307933 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-87d13687-4688-43b8-adc3-7afc096c9d2b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:53.322133 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-87d13687-4688-43b8-adc3-7afc096c9d2b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:53.325068 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-87d13687-4688-43b8-adc3-7afc096c9d2b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:53.328949 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-87d13687-4688-43b8-adc3-7afc096c9d2b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1739 microversion: 2.20 time: 0.198764 Sep 06 21:18:53.329526 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 329/653] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:53 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:18:53.691479 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ba4317d2-97d5-4c09-ade4-19805692b8ad tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:53.696055 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2905942f-0578-42b8-a857-4301fb59b854 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:53.697487 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2905942f-0578-42b8-a857-4301fb59b854 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:53.701496 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ba4317d2-97d5-4c09-ade4-19805692b8ad tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1443 microversion: 2.1 time: 0.530591 Sep 06 21:18:53.702957 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 325/654] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:53 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1443 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:53.707607 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2905942f-0578-42b8-a857-4301fb59b854 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:53.708072 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2905942f-0578-42b8-a857-4301fb59b854 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:53.708507 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2905942f-0578-42b8-a857-4301fb59b854 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:53.709269 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2905942f-0578-42b8-a857-4301fb59b854 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:53.709765 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2905942f-0578-42b8-a857-4301fb59b854 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:53.710179 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2905942f-0578-42b8-a857-4301fb59b854 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:53.880755 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2905942f-0578-42b8-a857-4301fb59b854 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:53.890855 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2905942f-0578-42b8-a857-4301fb59b854 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1722 microversion: 2.1 time: 0.199308 Sep 06 21:18:53.902884 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 330/655] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:53 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:54.356173 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-12c711ba-b576-449f-b4b8-6086eccac8dc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:54.357645 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-12c711ba-b576-449f-b4b8-6086eccac8dc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:54.369134 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12c711ba-b576-449f-b4b8-6086eccac8dc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:54.371804 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12c711ba-b576-449f-b4b8-6086eccac8dc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:54.372554 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12c711ba-b576-449f-b4b8-6086eccac8dc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:54.374953 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12c711ba-b576-449f-b4b8-6086eccac8dc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:54.375651 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12c711ba-b576-449f-b4b8-6086eccac8dc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:54.378255 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12c711ba-b576-449f-b4b8-6086eccac8dc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:54.536962 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-12c711ba-b576-449f-b4b8-6086eccac8dc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:54.549649 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-12c711ba-b576-449f-b4b8-6086eccac8dc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:54.551396 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-12c711ba-b576-449f-b4b8-6086eccac8dc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:54.552571 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-12c711ba-b576-449f-b4b8-6086eccac8dc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1739 microversion: 2.20 time: 0.200996 Sep 06 21:18:54.553157 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 326/656] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:54 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:18:55.112801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5ea54d4c-c379-4a92-a0ee-508006caaf0f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:55.113440 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5ea54d4c-c379-4a92-a0ee-508006caaf0f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:55.126426 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ea54d4c-c379-4a92-a0ee-508006caaf0f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:55.126920 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ea54d4c-c379-4a92-a0ee-508006caaf0f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:55.127351 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ea54d4c-c379-4a92-a0ee-508006caaf0f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:55.130998 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ea54d4c-c379-4a92-a0ee-508006caaf0f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:55.131457 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ea54d4c-c379-4a92-a0ee-508006caaf0f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:55.131884 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ea54d4c-c379-4a92-a0ee-508006caaf0f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:55.360882 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5ea54d4c-c379-4a92-a0ee-508006caaf0f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:55.376192 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5ea54d4c-c379-4a92-a0ee-508006caaf0f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1722 microversion: 2.1 time: 0.454213 Sep 06 21:18:55.395746 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 331/657] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:54 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1722 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:18:55.578746 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8f003be2-3f38-458b-b194-4fc43e6ddc61 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:55.580067 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8f003be2-3f38-458b-b194-4fc43e6ddc61 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:55.587152 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f003be2-3f38-458b-b194-4fc43e6ddc61 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:55.587898 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f003be2-3f38-458b-b194-4fc43e6ddc61 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:55.588552 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f003be2-3f38-458b-b194-4fc43e6ddc61 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:55.589462 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f003be2-3f38-458b-b194-4fc43e6ddc61 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:55.590061 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f003be2-3f38-458b-b194-4fc43e6ddc61 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:55.590691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f003be2-3f38-458b-b194-4fc43e6ddc61 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:55.616107 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:18:55.776458 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8f003be2-3f38-458b-b194-4fc43e6ddc61 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:55.789871 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8f003be2-3f38-458b-b194-4fc43e6ddc61 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:55.791749 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8f003be2-3f38-458b-b194-4fc43e6ddc61 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:55.793280 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8f003be2-3f38-458b-b194-4fc43e6ddc61 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1739 microversion: 2.20 time: 0.218563 Sep 06 21:18:55.793856 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 327/658] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:55 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1739 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 21:18:56.149035 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-e141a15e-8ab6-4ec4-beed-2609974c2a6a req-047d2faf-458e-48b0-b82a-0610241fd42a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "340de6d7-883f-4c26-89b1-4f8536aa09e8", "tag": "e03713ad-150d-4e1c-af49-98c4a6fe49fe"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:18:56.161273 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e141a15e-8ab6-4ec4-beed-2609974c2a6a req-047d2faf-458e-48b0-b82a-0610241fd42a service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:56.161739 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e141a15e-8ab6-4ec4-beed-2609974c2a6a req-047d2faf-458e-48b0-b82a-0610241fd42a service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:56.162152 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e141a15e-8ab6-4ec4-beed-2609974c2a6a req-047d2faf-458e-48b0-b82a-0610241fd42a service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:56.175582 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-e141a15e-8ab6-4ec4-beed-2609974c2a6a req-047d2faf-458e-48b0-b82a-0610241fd42a service nova] Creating event network-changed:e03713ad-150d-4e1c-af49-98c4a6fe49fe for instance 340de6d7-883f-4c26-89b1-4f8536aa09e8 on hv-cinder-74915 Sep 06 21:18:56.180740 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-e141a15e-8ab6-4ec4-beed-2609974c2a6a req-047d2faf-458e-48b0-b82a-0610241fd42a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035401 Sep 06 21:18:56.181341 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 332/659] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:18:56.405402 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-55537d03-01cd-47ee-bf42-0b7a113d5403 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:56.406541 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-55537d03-01cd-47ee-bf42-0b7a113d5403 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:56.416829 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55537d03-01cd-47ee-bf42-0b7a113d5403 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:56.417672 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55537d03-01cd-47ee-bf42-0b7a113d5403 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:56.418352 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55537d03-01cd-47ee-bf42-0b7a113d5403 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:56.419291 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55537d03-01cd-47ee-bf42-0b7a113d5403 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:56.420295 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55537d03-01cd-47ee-bf42-0b7a113d5403 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:56.421234 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55537d03-01cd-47ee-bf42-0b7a113d5403 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:56.721489 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-55537d03-01cd-47ee-bf42-0b7a113d5403 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:56.734201 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-55537d03-01cd-47ee-bf42-0b7a113d5403 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1722 microversion: 2.1 time: 0.334148 Sep 06 21:18:56.748767 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 328/660] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:56 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1722 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:56.822268 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8eb89640-6711-42ba-b916-54f1255885f2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:56.823603 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8eb89640-6711-42ba-b916-54f1255885f2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:56.831020 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8eb89640-6711-42ba-b916-54f1255885f2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:56.831583 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8eb89640-6711-42ba-b916-54f1255885f2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:56.832101 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8eb89640-6711-42ba-b916-54f1255885f2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:56.832892 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8eb89640-6711-42ba-b916-54f1255885f2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:56.833549 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8eb89640-6711-42ba-b916-54f1255885f2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:56.834218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8eb89640-6711-42ba-b916-54f1255885f2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:56.997092 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8eb89640-6711-42ba-b916-54f1255885f2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:57.010424 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8eb89640-6711-42ba-b916-54f1255885f2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:57.011917 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8eb89640-6711-42ba-b916-54f1255885f2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:57.013124 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8eb89640-6711-42ba-b916-54f1255885f2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1739 microversion: 2.20 time: 0.197064 Sep 06 21:18:57.020745 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 333/661] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:56 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:18:57.761835 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-75799543-3c23-42ca-af6b-351c4d9e27b4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:57.763803 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-75799543-3c23-42ca-af6b-351c4d9e27b4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:57.771341 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75799543-3c23-42ca-af6b-351c4d9e27b4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:57.772163 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75799543-3c23-42ca-af6b-351c4d9e27b4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:57.772887 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75799543-3c23-42ca-af6b-351c4d9e27b4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:57.773853 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75799543-3c23-42ca-af6b-351c4d9e27b4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:57.774513 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75799543-3c23-42ca-af6b-351c4d9e27b4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:57.775276 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75799543-3c23-42ca-af6b-351c4d9e27b4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:57.968026 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-75799543-3c23-42ca-af6b-351c4d9e27b4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:57.978122 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-75799543-3c23-42ca-af6b-351c4d9e27b4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1722 microversion: 2.1 time: 0.220421 Sep 06 21:18:57.989404 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 329/662] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:57 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:58.040807 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a9c22f34-c312-4e40-8c01-2bb718cdf07f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:58.041465 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a9c22f34-c312-4e40-8c01-2bb718cdf07f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:58.045322 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=90 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:18:58.058655 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9c22f34-c312-4e40-8c01-2bb718cdf07f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:58.059505 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9c22f34-c312-4e40-8c01-2bb718cdf07f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:58.060636 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9c22f34-c312-4e40-8c01-2bb718cdf07f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:58.068865 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9c22f34-c312-4e40-8c01-2bb718cdf07f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:58.069605 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9c22f34-c312-4e40-8c01-2bb718cdf07f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:58.070482 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9c22f34-c312-4e40-8c01-2bb718cdf07f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:58.236882 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a9c22f34-c312-4e40-8c01-2bb718cdf07f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:58.246551 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a9c22f34-c312-4e40-8c01-2bb718cdf07f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:58.248675 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a9c22f34-c312-4e40-8c01-2bb718cdf07f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:58.250013 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a9c22f34-c312-4e40-8c01-2bb718cdf07f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1739 microversion: 2.20 time: 0.213924 Sep 06 21:18:58.250900 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 334/663] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:58 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1739 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:18:59.003927 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ae87eceb-22b4-47d8-a8fa-b7f2650723d3 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:59.005429 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ae87eceb-22b4-47d8-a8fa-b7f2650723d3 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:59.009449 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:18:59.014180 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae87eceb-22b4-47d8-a8fa-b7f2650723d3 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:59.014674 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae87eceb-22b4-47d8-a8fa-b7f2650723d3 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:59.015249 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae87eceb-22b4-47d8-a8fa-b7f2650723d3 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:59.015961 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae87eceb-22b4-47d8-a8fa-b7f2650723d3 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:59.016409 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae87eceb-22b4-47d8-a8fa-b7f2650723d3 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:59.016934 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae87eceb-22b4-47d8-a8fa-b7f2650723d3 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:59.166773 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ae87eceb-22b4-47d8-a8fa-b7f2650723d3 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:59.177371 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ae87eceb-22b4-47d8-a8fa-b7f2650723d3 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1722 microversion: 2.1 time: 0.177649 Sep 06 21:18:59.178279 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 330/664] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:18:58 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:18:59.276926 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a092c7d4-ed16-4d5d-8395-cb2a3d6728d8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:18:59.277510 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a092c7d4-ed16-4d5d-8395-cb2a3d6728d8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:18:59.284832 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a092c7d4-ed16-4d5d-8395-cb2a3d6728d8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:59.285525 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a092c7d4-ed16-4d5d-8395-cb2a3d6728d8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:59.285971 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a092c7d4-ed16-4d5d-8395-cb2a3d6728d8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:59.286666 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a092c7d4-ed16-4d5d-8395-cb2a3d6728d8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:18:59.287105 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a092c7d4-ed16-4d5d-8395-cb2a3d6728d8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:18:59.287523 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a092c7d4-ed16-4d5d-8395-cb2a3d6728d8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:18:59.432589 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a092c7d4-ed16-4d5d-8395-cb2a3d6728d8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:59.441163 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a092c7d4-ed16-4d5d-8395-cb2a3d6728d8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:59.442595 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a092c7d4-ed16-4d5d-8395-cb2a3d6728d8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:18:59.443980 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a092c7d4-ed16-4d5d-8395-cb2a3d6728d8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1739 microversion: 2.20 time: 0.172352 Sep 06 21:18:59.462496 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 335/665] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:18:59 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:00.210225 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dfacc106-2137-4bd6-92aa-32938a0c7740 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:00.210907 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dfacc106-2137-4bd6-92aa-32938a0c7740 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:00.218447 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfacc106-2137-4bd6-92aa-32938a0c7740 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:00.219229 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfacc106-2137-4bd6-92aa-32938a0c7740 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:00.219975 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfacc106-2137-4bd6-92aa-32938a0c7740 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:00.222415 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfacc106-2137-4bd6-92aa-32938a0c7740 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:00.222415 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfacc106-2137-4bd6-92aa-32938a0c7740 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:00.222415 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfacc106-2137-4bd6-92aa-32938a0c7740 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:00.380851 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-dfacc106-2137-4bd6-92aa-32938a0c7740 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:00.395679 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dfacc106-2137-4bd6-92aa-32938a0c7740 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1722 microversion: 2.1 time: 0.196995 Sep 06 21:19:00.396269 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 331/666] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:00 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:00.470241 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-597dfa3a-a716-4e09-9084-7283eed1861b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:00.470826 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-597dfa3a-a716-4e09-9084-7283eed1861b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:00.480789 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-597dfa3a-a716-4e09-9084-7283eed1861b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:00.481282 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-597dfa3a-a716-4e09-9084-7283eed1861b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:00.481715 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-597dfa3a-a716-4e09-9084-7283eed1861b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:00.482429 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-597dfa3a-a716-4e09-9084-7283eed1861b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:00.483135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-597dfa3a-a716-4e09-9084-7283eed1861b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:00.483563 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-597dfa3a-a716-4e09-9084-7283eed1861b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:00.644066 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-597dfa3a-a716-4e09-9084-7283eed1861b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:00.653888 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-597dfa3a-a716-4e09-9084-7283eed1861b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:00.655784 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-597dfa3a-a716-4e09-9084-7283eed1861b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:00.657018 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-597dfa3a-a716-4e09-9084-7283eed1861b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1739 microversion: 2.20 time: 0.190952 Sep 06 21:19:00.668899 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 336/667] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:00 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:01.418974 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f7d00f93-c4d2-46d2-98fa-30d45f1766df tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:01.419741 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f7d00f93-c4d2-46d2-98fa-30d45f1766df tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:01.427263 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7d00f93-c4d2-46d2-98fa-30d45f1766df tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:01.427867 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7d00f93-c4d2-46d2-98fa-30d45f1766df tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:01.430132 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7d00f93-c4d2-46d2-98fa-30d45f1766df tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:01.430132 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7d00f93-c4d2-46d2-98fa-30d45f1766df tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:01.430132 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7d00f93-c4d2-46d2-98fa-30d45f1766df tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:01.430132 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7d00f93-c4d2-46d2-98fa-30d45f1766df tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:01.576703 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f7d00f93-c4d2-46d2-98fa-30d45f1766df tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:01.586557 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f7d00f93-c4d2-46d2-98fa-30d45f1766df tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1722 microversion: 2.1 time: 0.171469 Sep 06 21:19:01.587743 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 332/668] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:01 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:01.684021 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-85743c12-1001-4b38-99fc-1c314c34978c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:01.684573 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-85743c12-1001-4b38-99fc-1c314c34978c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:01.693443 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85743c12-1001-4b38-99fc-1c314c34978c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:01.693928 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85743c12-1001-4b38-99fc-1c314c34978c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:01.694395 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85743c12-1001-4b38-99fc-1c314c34978c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:01.695333 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85743c12-1001-4b38-99fc-1c314c34978c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:01.695825 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85743c12-1001-4b38-99fc-1c314c34978c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:01.696243 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85743c12-1001-4b38-99fc-1c314c34978c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:01.842239 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-85743c12-1001-4b38-99fc-1c314c34978c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:01.851527 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-85743c12-1001-4b38-99fc-1c314c34978c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:01.852993 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-85743c12-1001-4b38-99fc-1c314c34978c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:01.854561 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-85743c12-1001-4b38-99fc-1c314c34978c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1739 microversion: 2.20 time: 0.174843 Sep 06 21:19:01.855112 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 337/669] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:01 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:02.611535 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cd800b98-7761-4463-bdd1-555c547c23ad tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:02.612126 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cd800b98-7761-4463-bdd1-555c547c23ad tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:02.618973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd800b98-7761-4463-bdd1-555c547c23ad tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:02.619446 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd800b98-7761-4463-bdd1-555c547c23ad tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:02.619862 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd800b98-7761-4463-bdd1-555c547c23ad tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:02.620552 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd800b98-7761-4463-bdd1-555c547c23ad tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:02.621061 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd800b98-7761-4463-bdd1-555c547c23ad tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:02.621471 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd800b98-7761-4463-bdd1-555c547c23ad tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:02.783180 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cd800b98-7761-4463-bdd1-555c547c23ad tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:02.795530 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cd800b98-7761-4463-bdd1-555c547c23ad tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1722 microversion: 2.1 time: 0.188050 Sep 06 21:19:02.796580 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 333/670] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:02 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:02.883225 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9491b933-34e5-4676-a037-a30f04605ebd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:02.883830 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9491b933-34e5-4676-a037-a30f04605ebd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:02.891502 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9491b933-34e5-4676-a037-a30f04605ebd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:02.892219 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9491b933-34e5-4676-a037-a30f04605ebd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:02.893013 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9491b933-34e5-4676-a037-a30f04605ebd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:02.893914 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9491b933-34e5-4676-a037-a30f04605ebd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:02.894361 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9491b933-34e5-4676-a037-a30f04605ebd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:02.894944 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9491b933-34e5-4676-a037-a30f04605ebd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:03.059576 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9491b933-34e5-4676-a037-a30f04605ebd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:03.068771 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9491b933-34e5-4676-a037-a30f04605ebd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:03.070215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9491b933-34e5-4676-a037-a30f04605ebd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:03.071453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9491b933-34e5-4676-a037-a30f04605ebd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1739 microversion: 2.20 time: 0.192918 Sep 06 21:19:03.085049 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 338/671] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:02 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:03.820321 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5e20bb36-5b17-4e8d-af71-3c5e393a4abf tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:03.820971 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5e20bb36-5b17-4e8d-af71-3c5e393a4abf tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:03.828764 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e20bb36-5b17-4e8d-af71-3c5e393a4abf tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:03.829255 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e20bb36-5b17-4e8d-af71-3c5e393a4abf tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:03.829681 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e20bb36-5b17-4e8d-af71-3c5e393a4abf tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:03.830559 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e20bb36-5b17-4e8d-af71-3c5e393a4abf tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:03.831000 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e20bb36-5b17-4e8d-af71-3c5e393a4abf tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:03.831421 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e20bb36-5b17-4e8d-af71-3c5e393a4abf tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:03.976155 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5e20bb36-5b17-4e8d-af71-3c5e393a4abf tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:03.985265 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5e20bb36-5b17-4e8d-af71-3c5e393a4abf tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1722 microversion: 2.1 time: 0.168914 Sep 06 21:19:04.001279 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 334/672] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:03 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:04.099342 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-74f67a10-7848-4bb2-8ffb-621fc9cec941 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:04.100058 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-74f67a10-7848-4bb2-8ffb-621fc9cec941 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:04.107197 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74f67a10-7848-4bb2-8ffb-621fc9cec941 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:04.107651 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74f67a10-7848-4bb2-8ffb-621fc9cec941 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:04.108115 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74f67a10-7848-4bb2-8ffb-621fc9cec941 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:04.108845 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74f67a10-7848-4bb2-8ffb-621fc9cec941 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:04.109323 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74f67a10-7848-4bb2-8ffb-621fc9cec941 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:04.109718 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74f67a10-7848-4bb2-8ffb-621fc9cec941 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:04.261484 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-74f67a10-7848-4bb2-8ffb-621fc9cec941 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:04.270681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-74f67a10-7848-4bb2-8ffb-621fc9cec941 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:04.272108 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-74f67a10-7848-4bb2-8ffb-621fc9cec941 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:04.273302 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-74f67a10-7848-4bb2-8ffb-621fc9cec941 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1739 microversion: 2.20 time: 0.178474 Sep 06 21:19:04.273871 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 339/673] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:04 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:05.011354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ca1075c0-007a-426c-be47-5a4a200a85e1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:05.012147 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ca1075c0-007a-426c-be47-5a4a200a85e1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:05.020519 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca1075c0-007a-426c-be47-5a4a200a85e1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:05.021012 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca1075c0-007a-426c-be47-5a4a200a85e1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:05.021480 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca1075c0-007a-426c-be47-5a4a200a85e1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:05.022175 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca1075c0-007a-426c-be47-5a4a200a85e1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:05.022626 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca1075c0-007a-426c-be47-5a4a200a85e1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:05.023046 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca1075c0-007a-426c-be47-5a4a200a85e1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:05.163218 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ca1075c0-007a-426c-be47-5a4a200a85e1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:05.174948 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ca1075c0-007a-426c-be47-5a4a200a85e1 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1722 microversion: 2.1 time: 0.168963 Sep 06 21:19:05.175534 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 335/674] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:05 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:05.306151 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-876f0b2b-cc31-4f83-81af-c7cf78a1c048 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:05.307031 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-876f0b2b-cc31-4f83-81af-c7cf78a1c048 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:05.317390 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-876f0b2b-cc31-4f83-81af-c7cf78a1c048 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:05.318140 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-876f0b2b-cc31-4f83-81af-c7cf78a1c048 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:05.318821 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-876f0b2b-cc31-4f83-81af-c7cf78a1c048 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:05.319882 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-876f0b2b-cc31-4f83-81af-c7cf78a1c048 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:05.320587 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-876f0b2b-cc31-4f83-81af-c7cf78a1c048 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:05.321283 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-876f0b2b-cc31-4f83-81af-c7cf78a1c048 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:05.456858 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-876f0b2b-cc31-4f83-81af-c7cf78a1c048 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:05.469699 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-876f0b2b-cc31-4f83-81af-c7cf78a1c048 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:05.471135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-876f0b2b-cc31-4f83-81af-c7cf78a1c048 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:05.472293 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-876f0b2b-cc31-4f83-81af-c7cf78a1c048 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1739 microversion: 2.20 time: 0.172314 Sep 06 21:19:05.472872 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 340/675] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:05 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:06.202322 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-32e724a5-ec13-4f18-bc63-7923e0557bb6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:06.203183 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-32e724a5-ec13-4f18-bc63-7923e0557bb6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:06.213507 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32e724a5-ec13-4f18-bc63-7923e0557bb6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:06.214207 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32e724a5-ec13-4f18-bc63-7923e0557bb6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:06.214815 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32e724a5-ec13-4f18-bc63-7923e0557bb6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:06.215871 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32e724a5-ec13-4f18-bc63-7923e0557bb6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:06.216259 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32e724a5-ec13-4f18-bc63-7923e0557bb6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:06.217063 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32e724a5-ec13-4f18-bc63-7923e0557bb6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:06.371052 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-32e724a5-ec13-4f18-bc63-7923e0557bb6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:06.379915 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-32e724a5-ec13-4f18-bc63-7923e0557bb6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1699 microversion: 2.1 time: 0.184032 Sep 06 21:19:06.380496 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 336/676] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:06 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1699 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:06.408270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-01b79500-7419-49ba-944f-887a4b227f5d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:19:06.415393 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01b79500-7419-49ba-944f-887a4b227f5d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:06.416133 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01b79500-7419-49ba-944f-887a4b227f5d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:06.416556 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01b79500-7419-49ba-944f-887a4b227f5d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:06.478579 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-01b79500-7419-49ba-944f-887a4b227f5d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Going to try to start instance {{(pid=120719) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 06 21:19:06.497962 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-771aeced-d807-41f0-ba00-c674723543d3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:06.499027 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-771aeced-d807-41f0-ba00-c674723543d3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:06.505988 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-771aeced-d807-41f0-ba00-c674723543d3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:06.506475 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-771aeced-d807-41f0-ba00-c674723543d3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:06.506938 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-771aeced-d807-41f0-ba00-c674723543d3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:06.507653 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-771aeced-d807-41f0-ba00-c674723543d3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:06.508098 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-771aeced-d807-41f0-ba00-c674723543d3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:06.508514 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-771aeced-d807-41f0-ba00-c674723543d3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:06.527224 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-01b79500-7419-49ba-944f-887a4b227f5d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "POST /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f/action" status: 202 len: 0 microversion: 2.1 time: 0.122525 Sep 06 21:19:06.528562 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 341/677] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Sep 6 21:19:06 2022] POST /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:19:06.538822 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d02f0b67-02d2-4c2f-babd-3a6f984d7147 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:06.539540 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d02f0b67-02d2-4c2f-babd-3a6f984d7147 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:06.547392 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d02f0b67-02d2-4c2f-babd-3a6f984d7147 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:06.548557 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d02f0b67-02d2-4c2f-babd-3a6f984d7147 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:06.549074 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d02f0b67-02d2-4c2f-babd-3a6f984d7147 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:06.549892 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d02f0b67-02d2-4c2f-babd-3a6f984d7147 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:06.550598 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d02f0b67-02d2-4c2f-babd-3a6f984d7147 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:06.551039 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d02f0b67-02d2-4c2f-babd-3a6f984d7147 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:06.708470 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-771aeced-d807-41f0-ba00-c674723543d3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:06.711627 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d02f0b67-02d2-4c2f-babd-3a6f984d7147 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:06.717114 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-771aeced-d807-41f0-ba00-c674723543d3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:06.718878 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-771aeced-d807-41f0-ba00-c674723543d3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:06.720209 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-771aeced-d807-41f0-ba00-c674723543d3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1721 microversion: 2.20 time: 0.226382 Sep 06 21:19:06.720341 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d02f0b67-02d2-4c2f-babd-3a6f984d7147 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1708 microversion: 2.1 time: 0.186762 Sep 06 21:19:06.721008 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 337/678] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:06 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:06.721149 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 342/679] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:06 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1708 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:07.744322 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-12997edf-194d-4c93-8bf0-c335b16a9995 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:07.744887 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-12997edf-194d-4c93-8bf0-c335b16a9995 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:07.745446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dd594a89-2c88-4992-8681-83723d51e67a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:07.746082 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dd594a89-2c88-4992-8681-83723d51e67a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:07.751970 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12997edf-194d-4c93-8bf0-c335b16a9995 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:07.752448 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12997edf-194d-4c93-8bf0-c335b16a9995 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:07.752895 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12997edf-194d-4c93-8bf0-c335b16a9995 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:07.753103 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd594a89-2c88-4992-8681-83723d51e67a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:07.753585 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12997edf-194d-4c93-8bf0-c335b16a9995 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:07.753708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd594a89-2c88-4992-8681-83723d51e67a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:07.754025 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12997edf-194d-4c93-8bf0-c335b16a9995 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:07.754434 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12997edf-194d-4c93-8bf0-c335b16a9995 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:07.754660 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd594a89-2c88-4992-8681-83723d51e67a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:07.755369 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd594a89-2c88-4992-8681-83723d51e67a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:07.755830 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd594a89-2c88-4992-8681-83723d51e67a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:07.756265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd594a89-2c88-4992-8681-83723d51e67a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:07.760536 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:19:07.888693 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-12997edf-194d-4c93-8bf0-c335b16a9995 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:07.889861 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-dd594a89-2c88-4992-8681-83723d51e67a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:07.897526 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-12997edf-194d-4c93-8bf0-c335b16a9995 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1708 microversion: 2.1 time: 0.157301 Sep 06 21:19:07.898012 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-dd594a89-2c88-4992-8681-83723d51e67a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:07.898584 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 338/680] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:07 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1708 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:07.899542 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-dd594a89-2c88-4992-8681-83723d51e67a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:07.900845 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dd594a89-2c88-4992-8681-83723d51e67a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1721 microversion: 2.20 time: 0.159342 Sep 06 21:19:07.901449 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 343/681] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:07 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 21:19:08.924676 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7a20f9b1-d5d1-4efd-94f8-632c6a68fc05 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:08.925356 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7a20f9b1-d5d1-4efd-94f8-632c6a68fc05 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:08.928239 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a0996bd2-5002-43d9-9c17-1485f31ace5c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:08.929024 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a0996bd2-5002-43d9-9c17-1485f31ace5c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:08.932483 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a20f9b1-d5d1-4efd-94f8-632c6a68fc05 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:08.933086 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a20f9b1-d5d1-4efd-94f8-632c6a68fc05 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:08.933563 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a20f9b1-d5d1-4efd-94f8-632c6a68fc05 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:08.934266 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a20f9b1-d5d1-4efd-94f8-632c6a68fc05 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:08.934714 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a20f9b1-d5d1-4efd-94f8-632c6a68fc05 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:08.935164 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a20f9b1-d5d1-4efd-94f8-632c6a68fc05 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:08.935644 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0996bd2-5002-43d9-9c17-1485f31ace5c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:08.936131 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0996bd2-5002-43d9-9c17-1485f31ace5c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:08.936561 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0996bd2-5002-43d9-9c17-1485f31ace5c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:08.937283 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0996bd2-5002-43d9-9c17-1485f31ace5c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:08.937712 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0996bd2-5002-43d9-9c17-1485f31ace5c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:08.938131 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0996bd2-5002-43d9-9c17-1485f31ace5c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:09.089640 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a0996bd2-5002-43d9-9c17-1485f31ace5c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:09.089806 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7a20f9b1-d5d1-4efd-94f8-632c6a68fc05 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:09.098382 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7a20f9b1-d5d1-4efd-94f8-632c6a68fc05 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1708 microversion: 2.1 time: 0.179918 Sep 06 21:19:09.098952 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 339/682] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:08 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1708 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:09.104441 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a0996bd2-5002-43d9-9c17-1485f31ace5c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:09.105960 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a0996bd2-5002-43d9-9c17-1485f31ace5c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:09.107127 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a0996bd2-5002-43d9-9c17-1485f31ace5c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1721 microversion: 2.20 time: 0.183143 Sep 06 21:19:09.107666 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 344/683] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:08 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:10.124501 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b413ee9a-c7b3-46f1-847e-e4db6760e109 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:10.125167 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b413ee9a-c7b3-46f1-847e-e4db6760e109 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:10.132693 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b413ee9a-c7b3-46f1-847e-e4db6760e109 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:10.133190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b413ee9a-c7b3-46f1-847e-e4db6760e109 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:10.133883 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b413ee9a-c7b3-46f1-847e-e4db6760e109 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:10.134309 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b413ee9a-c7b3-46f1-847e-e4db6760e109 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:10.134775 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b413ee9a-c7b3-46f1-847e-e4db6760e109 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:10.135206 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b413ee9a-c7b3-46f1-847e-e4db6760e109 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:10.138985 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-77623dc7-1e43-4eac-a51f-596c47015891 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:10.139741 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-77623dc7-1e43-4eac-a51f-596c47015891 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:10.146610 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77623dc7-1e43-4eac-a51f-596c47015891 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:10.147103 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77623dc7-1e43-4eac-a51f-596c47015891 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:10.147572 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77623dc7-1e43-4eac-a51f-596c47015891 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:10.148283 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77623dc7-1e43-4eac-a51f-596c47015891 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:10.148766 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77623dc7-1e43-4eac-a51f-596c47015891 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:10.149196 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77623dc7-1e43-4eac-a51f-596c47015891 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:10.277392 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b413ee9a-c7b3-46f1-847e-e4db6760e109 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:10.283609 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-77623dc7-1e43-4eac-a51f-596c47015891 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:10.286487 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b413ee9a-c7b3-46f1-847e-e4db6760e109 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1708 microversion: 2.1 time: 0.165869 Sep 06 21:19:10.287110 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 340/684] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:10 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1708 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:10.292127 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-77623dc7-1e43-4eac-a51f-596c47015891 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:10.293752 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-77623dc7-1e43-4eac-a51f-596c47015891 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:10.295029 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-77623dc7-1e43-4eac-a51f-596c47015891 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1721 microversion: 2.20 time: 0.160057 Sep 06 21:19:10.295605 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 345/685] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:10 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:11.315002 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fc8005bc-66ec-4821-9493-454adf4b4f8b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:11.315974 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fc8005bc-66ec-4821-9493-454adf4b4f8b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:11.324613 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c76e5bdc-9628-470c-bb93-9fc2087109d9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:11.325598 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c76e5bdc-9628-470c-bb93-9fc2087109d9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:11.326784 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc8005bc-66ec-4821-9493-454adf4b4f8b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:11.327582 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc8005bc-66ec-4821-9493-454adf4b4f8b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:11.328303 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc8005bc-66ec-4821-9493-454adf4b4f8b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:11.329418 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc8005bc-66ec-4821-9493-454adf4b4f8b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:11.329866 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc8005bc-66ec-4821-9493-454adf4b4f8b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:11.330278 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc8005bc-66ec-4821-9493-454adf4b4f8b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:11.333739 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c76e5bdc-9628-470c-bb93-9fc2087109d9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:11.334229 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c76e5bdc-9628-470c-bb93-9fc2087109d9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:11.334681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c76e5bdc-9628-470c-bb93-9fc2087109d9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:11.335366 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c76e5bdc-9628-470c-bb93-9fc2087109d9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:11.335811 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c76e5bdc-9628-470c-bb93-9fc2087109d9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:11.336235 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c76e5bdc-9628-470c-bb93-9fc2087109d9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:11.465291 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fc8005bc-66ec-4821-9493-454adf4b4f8b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:11.468171 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c76e5bdc-9628-470c-bb93-9fc2087109d9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:11.474058 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fc8005bc-66ec-4821-9493-454adf4b4f8b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1708 microversion: 2.1 time: 0.165513 Sep 06 21:19:11.474809 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 341/686] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:11 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1708 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:11.476927 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c76e5bdc-9628-470c-bb93-9fc2087109d9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:11.478337 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c76e5bdc-9628-470c-bb93-9fc2087109d9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:11.479450 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c76e5bdc-9628-470c-bb93-9fc2087109d9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1721 microversion: 2.20 time: 0.161533 Sep 06 21:19:11.479983 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 346/687] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:11 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:12.498288 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-990ce4da-e9ef-4dba-b8a1-a7a218ed47bb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:12.498937 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-990ce4da-e9ef-4dba-b8a1-a7a218ed47bb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:12.507985 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-990ce4da-e9ef-4dba-b8a1-a7a218ed47bb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:12.508479 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-990ce4da-e9ef-4dba-b8a1-a7a218ed47bb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:12.508948 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-990ce4da-e9ef-4dba-b8a1-a7a218ed47bb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:12.509663 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-990ce4da-e9ef-4dba-b8a1-a7a218ed47bb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:12.510118 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-990ce4da-e9ef-4dba-b8a1-a7a218ed47bb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:12.510534 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-990ce4da-e9ef-4dba-b8a1-a7a218ed47bb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:12.511336 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f709e58d-ac3a-441c-a648-f7c45e2fe75f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:12.511983 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f709e58d-ac3a-441c-a648-f7c45e2fe75f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:12.521624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f709e58d-ac3a-441c-a648-f7c45e2fe75f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:12.522708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f709e58d-ac3a-441c-a648-f7c45e2fe75f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:12.523149 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f709e58d-ac3a-441c-a648-f7c45e2fe75f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:12.523903 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f709e58d-ac3a-441c-a648-f7c45e2fe75f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:12.524352 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f709e58d-ac3a-441c-a648-f7c45e2fe75f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:12.524794 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f709e58d-ac3a-441c-a648-f7c45e2fe75f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:12.655447 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-990ce4da-e9ef-4dba-b8a1-a7a218ed47bb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:12.664572 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-990ce4da-e9ef-4dba-b8a1-a7a218ed47bb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1708 microversion: 2.1 time: 0.171158 Sep 06 21:19:12.665261 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 342/688] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:12 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1708 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:12.670490 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-f1bd65ed-af24-47ec-870d-52219a5fcf20 req-a693c65e-1a54-48da-bbfd-a1956d3dda04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fea1aa0-032e-454d-9358-98a81cd5d650", "name": "network-vif-unplugged", "status": "completed", "tag": "7ea4447f-6e97-421a-ae16-09790d6651e8"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:19:12.683015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f1bd65ed-af24-47ec-870d-52219a5fcf20 req-a693c65e-1a54-48da-bbfd-a1956d3dda04 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:12.683734 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f1bd65ed-af24-47ec-870d-52219a5fcf20 req-a693c65e-1a54-48da-bbfd-a1956d3dda04 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:12.684158 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f1bd65ed-af24-47ec-870d-52219a5fcf20 req-a693c65e-1a54-48da-bbfd-a1956d3dda04 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:12.695982 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-f1bd65ed-af24-47ec-870d-52219a5fcf20 req-a693c65e-1a54-48da-bbfd-a1956d3dda04 service nova] Creating event network-vif-unplugged:7ea4447f-6e97-421a-ae16-09790d6651e8 for instance 8fea1aa0-032e-454d-9358-98a81cd5d650 on hv-cinder-74915 Sep 06 21:19:12.701415 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-f1bd65ed-af24-47ec-870d-52219a5fcf20 req-a693c65e-1a54-48da-bbfd-a1956d3dda04 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035014 Sep 06 21:19:12.702009 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 343/689] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:19:12.730837 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f709e58d-ac3a-441c-a648-f7c45e2fe75f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:12.740047 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f709e58d-ac3a-441c-a648-f7c45e2fe75f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:12.741551 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f709e58d-ac3a-441c-a648-f7c45e2fe75f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:12.742862 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f709e58d-ac3a-441c-a648-f7c45e2fe75f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1721 microversion: 2.20 time: 0.239094 Sep 06 21:19:12.743448 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 347/690] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:12 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1721 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:13.692636 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c2a62c12-dfba-4373-aae8-09a614c31e51 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:13.693396 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c2a62c12-dfba-4373-aae8-09a614c31e51 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:13.700385 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c2a62c12-dfba-4373-aae8-09a614c31e51 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:13.700927 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c2a62c12-dfba-4373-aae8-09a614c31e51 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:13.701373 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c2a62c12-dfba-4373-aae8-09a614c31e51 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:13.702063 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c2a62c12-dfba-4373-aae8-09a614c31e51 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:13.702512 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c2a62c12-dfba-4373-aae8-09a614c31e51 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:13.702930 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c2a62c12-dfba-4373-aae8-09a614c31e51 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:13.768041 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-17869dd5-e2d8-4cd9-b1ea-dfb1607a6deb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:13.768784 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-17869dd5-e2d8-4cd9-b1ea-dfb1607a6deb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:13.775284 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17869dd5-e2d8-4cd9-b1ea-dfb1607a6deb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:13.775783 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17869dd5-e2d8-4cd9-b1ea-dfb1607a6deb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:13.776215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17869dd5-e2d8-4cd9-b1ea-dfb1607a6deb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:13.777223 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17869dd5-e2d8-4cd9-b1ea-dfb1607a6deb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:13.777894 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17869dd5-e2d8-4cd9-b1ea-dfb1607a6deb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:13.778921 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17869dd5-e2d8-4cd9-b1ea-dfb1607a6deb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:13.854094 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c2a62c12-dfba-4373-aae8-09a614c31e51 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:13.857646 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:19:13.863104 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c2a62c12-dfba-4373-aae8-09a614c31e51 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1708 microversion: 2.1 time: 0.176894 Sep 06 21:19:13.863672 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 344/691] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:13 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1708 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:13.927445 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-17869dd5-e2d8-4cd9-b1ea-dfb1607a6deb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:13.939111 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-17869dd5-e2d8-4cd9-b1ea-dfb1607a6deb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:13.941237 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-17869dd5-e2d8-4cd9-b1ea-dfb1607a6deb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:13.942397 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-17869dd5-e2d8-4cd9-b1ea-dfb1607a6deb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1724 microversion: 2.20 time: 0.178341 Sep 06 21:19:13.942974 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 348/692] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:13 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:13.968840 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a84a293f-bb1f-4dc9-b77b-acc135764edd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b8eeae6-67cb-4679-8052-cd6ce60a9e52"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:19:13.971391 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a84a293f-bb1f-4dc9-b77b-acc135764edd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:13.978085 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a84a293f-bb1f-4dc9-b77b-acc135764edd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:13.978570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a84a293f-bb1f-4dc9-b77b-acc135764edd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:13.979153 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a84a293f-bb1f-4dc9-b77b-acc135764edd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:13.979854 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a84a293f-bb1f-4dc9-b77b-acc135764edd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:13.980305 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a84a293f-bb1f-4dc9-b77b-acc135764edd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:13.980782 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a84a293f-bb1f-4dc9-b77b-acc135764edd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:14.289105 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a84a293f-bb1f-4dc9-b77b-acc135764edd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "POST /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.325150 Sep 06 21:19:14.289724 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 345/693] 10.222.0.79 () {62 vars in 1364 bytes} [Tue Sep 6 21:19:13 2022] POST /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650/os-volume_attachments => generated 188 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 21:19:14.418596 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-24049de1-e526-47bb-a209-498c9db88adf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:19:14.419178 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-24049de1-e526-47bb-a209-498c9db88adf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:14.425661 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24049de1-e526-47bb-a209-498c9db88adf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:14.426133 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24049de1-e526-47bb-a209-498c9db88adf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:14.426558 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24049de1-e526-47bb-a209-498c9db88adf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:14.427247 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24049de1-e526-47bb-a209-498c9db88adf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:14.427685 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24049de1-e526-47bb-a209-498c9db88adf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:14.428099 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24049de1-e526-47bb-a209-498c9db88adf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:14.534461 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-24049de1-e526-47bb-a209-498c9db88adf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120719) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 06 21:19:14.616373 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-24049de1-e526-47bb-a209-498c9db88adf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "POST /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650/action" status: 202 len: 0 microversion: 2.20 time: 0.201619 Sep 06 21:19:14.617055 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 349/694] 10.222.0.79 () {62 vars in 1319 bytes} [Tue Sep 6 21:19:14 2022] POST /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 21:19:14.625461 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b0005823-b8fc-49d7-8c5b-d15c4feca6d8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:14.626160 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b0005823-b8fc-49d7-8c5b-d15c4feca6d8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:14.633531 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0005823-b8fc-49d7-8c5b-d15c4feca6d8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:14.634037 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0005823-b8fc-49d7-8c5b-d15c4feca6d8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:14.634555 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0005823-b8fc-49d7-8c5b-d15c4feca6d8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:14.635443 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0005823-b8fc-49d7-8c5b-d15c4feca6d8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:14.635970 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0005823-b8fc-49d7-8c5b-d15c4feca6d8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:14.636469 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0005823-b8fc-49d7-8c5b-d15c4feca6d8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:14.778815 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b0005823-b8fc-49d7-8c5b-d15c4feca6d8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:14.787926 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b0005823-b8fc-49d7-8c5b-d15c4feca6d8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:14.789398 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b0005823-b8fc-49d7-8c5b-d15c4feca6d8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:14.790579 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b0005823-b8fc-49d7-8c5b-d15c4feca6d8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1750 microversion: 2.20 time: 0.169260 Sep 06 21:19:14.791137 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 346/695] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:14 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1750 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 21:19:14.890789 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-50da5561-301d-46b1-86ba-db89ffa69c86 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:14.891456 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-50da5561-301d-46b1-86ba-db89ffa69c86 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:14.898566 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50da5561-301d-46b1-86ba-db89ffa69c86 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:14.899409 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50da5561-301d-46b1-86ba-db89ffa69c86 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:14.900110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50da5561-301d-46b1-86ba-db89ffa69c86 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:14.900811 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50da5561-301d-46b1-86ba-db89ffa69c86 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:14.901317 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50da5561-301d-46b1-86ba-db89ffa69c86 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:14.901804 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50da5561-301d-46b1-86ba-db89ffa69c86 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:15.070319 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-50da5561-301d-46b1-86ba-db89ffa69c86 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:15.079398 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-50da5561-301d-46b1-86ba-db89ffa69c86 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1712 microversion: 2.1 time: 0.193245 Sep 06 21:19:15.079933 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 350/696] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:14 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1712 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:15.526379 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e0a45398-c149-4e40-b2ec-3c080c464c65 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:15.526870 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e0a45398-c149-4e40-b2ec-3c080c464c65 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:15.533845 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e0a45398-c149-4e40-b2ec-3c080c464c65 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:15.534626 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e0a45398-c149-4e40-b2ec-3c080c464c65 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:15.535192 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e0a45398-c149-4e40-b2ec-3c080c464c65 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:15.535933 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e0a45398-c149-4e40-b2ec-3c080c464c65 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:15.536366 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e0a45398-c149-4e40-b2ec-3c080c464c65 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:15.536838 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e0a45398-c149-4e40-b2ec-3c080c464c65 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:15.627638 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-e0a45398-c149-4e40-b2ec-3c080c464c65 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lazy-loading 'services' on Instance uuid 0652742c-8554-4c35-89cd-8ff0fb44659f {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:19:15.709937 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e0a45398-c149-4e40-b2ec-3c080c464c65 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f/os-volume_attachments/4a5b9f50-5423-4337-a509-6ec4e915a400" status: 202 len: 0 microversion: 2.1 time: 0.187328 Sep 06 21:19:15.710946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 347/697] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Sep 6 21:19:15 2022] DELETE /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f/os-volume_attachments/4a5b9f50-5423-4337-a509-6ec4e915a400 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:19:15.817570 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a42889a8-cce0-4270-b249-bbd8126d75ff tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:15.818176 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a42889a8-cce0-4270-b249-bbd8126d75ff tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:15.825823 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a42889a8-cce0-4270-b249-bbd8126d75ff tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:15.826459 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a42889a8-cce0-4270-b249-bbd8126d75ff tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:15.826898 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a42889a8-cce0-4270-b249-bbd8126d75ff tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:15.827648 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a42889a8-cce0-4270-b249-bbd8126d75ff tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:15.828122 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a42889a8-cce0-4270-b249-bbd8126d75ff tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:15.828546 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a42889a8-cce0-4270-b249-bbd8126d75ff tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:15.969361 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a42889a8-cce0-4270-b249-bbd8126d75ff tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:15.978398 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a42889a8-cce0-4270-b249-bbd8126d75ff tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:15.979815 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a42889a8-cce0-4270-b249-bbd8126d75ff tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:15.981000 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a42889a8-cce0-4270-b249-bbd8126d75ff tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1752 microversion: 2.20 time: 0.167294 Sep 06 21:19:15.981557 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 351/698] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:15 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:17.011067 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-29f4f13a-3bc4-4559-81fc-fddef0ad40ad tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:17.012078 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-29f4f13a-3bc4-4559-81fc-fddef0ad40ad tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:17.022490 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29f4f13a-3bc4-4559-81fc-fddef0ad40ad tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:17.022982 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29f4f13a-3bc4-4559-81fc-fddef0ad40ad tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:17.023393 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29f4f13a-3bc4-4559-81fc-fddef0ad40ad tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:17.024125 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29f4f13a-3bc4-4559-81fc-fddef0ad40ad tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:17.024579 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29f4f13a-3bc4-4559-81fc-fddef0ad40ad tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:17.025021 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29f4f13a-3bc4-4559-81fc-fddef0ad40ad tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:17.170054 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-29f4f13a-3bc4-4559-81fc-fddef0ad40ad tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:17.180685 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-29f4f13a-3bc4-4559-81fc-fddef0ad40ad tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:17.182696 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-29f4f13a-3bc4-4559-81fc-fddef0ad40ad tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:17.183438 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-29f4f13a-3bc4-4559-81fc-fddef0ad40ad tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1752 microversion: 2.20 time: 0.179200 Sep 06 21:19:17.183967 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 348/699] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:17 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:17.911188 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a36c236d-48e2-473e-b3a6-f570371cbf65 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:17.911783 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a36c236d-48e2-473e-b3a6-f570371cbf65 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:17.918876 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a36c236d-48e2-473e-b3a6-f570371cbf65 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:17.919459 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a36c236d-48e2-473e-b3a6-f570371cbf65 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:17.920038 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a36c236d-48e2-473e-b3a6-f570371cbf65 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:17.920977 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a36c236d-48e2-473e-b3a6-f570371cbf65 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:17.921604 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a36c236d-48e2-473e-b3a6-f570371cbf65 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:17.922036 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a36c236d-48e2-473e-b3a6-f570371cbf65 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:17.950158 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a36c236d-48e2-473e-b3a6-f570371cbf65 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 21:19:18.035513 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a36c236d-48e2-473e-b3a6-f570371cbf65 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 204 len: 0 microversion: 2.1 time: 0.127886 Sep 06 21:19:18.036467 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 352/700] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Sep 6 21:19:17 2022] DELETE /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 21:19:18.045546 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-92a01fc8-a190-4d82-a4ea-af7d879e8d51 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:18.046870 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-92a01fc8-a190-4d82-a4ea-af7d879e8d51 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:18.054071 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92a01fc8-a190-4d82-a4ea-af7d879e8d51 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:18.054552 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92a01fc8-a190-4d82-a4ea-af7d879e8d51 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:18.054979 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92a01fc8-a190-4d82-a4ea-af7d879e8d51 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:18.055688 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92a01fc8-a190-4d82-a4ea-af7d879e8d51 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:18.056131 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92a01fc8-a190-4d82-a4ea-af7d879e8d51 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:18.056573 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92a01fc8-a190-4d82-a4ea-af7d879e8d51 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:18.195172 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-92a01fc8-a190-4d82-a4ea-af7d879e8d51 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:18.203553 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-92a01fc8-a190-4d82-a4ea-af7d879e8d51 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1513 microversion: 2.1 time: 0.162217 Sep 06 21:19:18.204116 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 349/701] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:18 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:18.212511 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-46281f69-fb46-4eb2-a6a2-ae71638bb09b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:18.213232 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-46281f69-fb46-4eb2-a6a2-ae71638bb09b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:18.219406 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46281f69-fb46-4eb2-a6a2-ae71638bb09b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:18.219885 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46281f69-fb46-4eb2-a6a2-ae71638bb09b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:18.220315 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46281f69-fb46-4eb2-a6a2-ae71638bb09b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:18.221032 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46281f69-fb46-4eb2-a6a2-ae71638bb09b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:18.221479 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46281f69-fb46-4eb2-a6a2-ae71638bb09b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:18.221899 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46281f69-fb46-4eb2-a6a2-ae71638bb09b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:18.369290 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-46281f69-fb46-4eb2-a6a2-ae71638bb09b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:18.383356 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-46281f69-fb46-4eb2-a6a2-ae71638bb09b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:18.385691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-46281f69-fb46-4eb2-a6a2-ae71638bb09b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:18.387571 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-46281f69-fb46-4eb2-a6a2-ae71638bb09b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1752 microversion: 2.20 time: 0.179361 Sep 06 21:19:18.388475 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 353/702] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:18 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:19.232338 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-01c61d09-e55f-4fc9-9269-4499403a9d6f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:19.233334 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-01c61d09-e55f-4fc9-9269-4499403a9d6f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:19.243266 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01c61d09-e55f-4fc9-9269-4499403a9d6f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:19.243741 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01c61d09-e55f-4fc9-9269-4499403a9d6f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:19.244139 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01c61d09-e55f-4fc9-9269-4499403a9d6f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:19.244889 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01c61d09-e55f-4fc9-9269-4499403a9d6f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:19.245331 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01c61d09-e55f-4fc9-9269-4499403a9d6f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:19.245741 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01c61d09-e55f-4fc9-9269-4499403a9d6f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:19.380640 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-01c61d09-e55f-4fc9-9269-4499403a9d6f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:19.390443 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-01c61d09-e55f-4fc9-9269-4499403a9d6f tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1513 microversion: 2.1 time: 0.164989 Sep 06 21:19:19.390984 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 350/703] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:19 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:19.419192 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fa87a42a-c731-4577-a82c-36f2037347d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:19.419815 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fa87a42a-c731-4577-a82c-36f2037347d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:19.429580 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa87a42a-c731-4577-a82c-36f2037347d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:19.430058 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa87a42a-c731-4577-a82c-36f2037347d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:19.430487 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa87a42a-c731-4577-a82c-36f2037347d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:19.431187 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa87a42a-c731-4577-a82c-36f2037347d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:19.431630 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa87a42a-c731-4577-a82c-36f2037347d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:19.432053 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa87a42a-c731-4577-a82c-36f2037347d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:19.578071 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-fa87a42a-c731-4577-a82c-36f2037347d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:19.587428 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-fa87a42a-c731-4577-a82c-36f2037347d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:19.589107 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-fa87a42a-c731-4577-a82c-36f2037347d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:19.590270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fa87a42a-c731-4577-a82c-36f2037347d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1752 microversion: 2.20 time: 0.177639 Sep 06 21:19:19.590822 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 354/704] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:19 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:20.418240 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a7cb8721-c830-4a47-96b2-14cfe2560601 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:20.418240 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a7cb8721-c830-4a47-96b2-14cfe2560601 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:20.425774 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7cb8721-c830-4a47-96b2-14cfe2560601 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:20.426287 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7cb8721-c830-4a47-96b2-14cfe2560601 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:20.426721 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7cb8721-c830-4a47-96b2-14cfe2560601 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:20.427420 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7cb8721-c830-4a47-96b2-14cfe2560601 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:20.427868 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7cb8721-c830-4a47-96b2-14cfe2560601 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:20.428270 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7cb8721-c830-4a47-96b2-14cfe2560601 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:20.569636 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a7cb8721-c830-4a47-96b2-14cfe2560601 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:20.579466 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a7cb8721-c830-4a47-96b2-14cfe2560601 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1513 microversion: 2.1 time: 0.166313 Sep 06 21:19:20.580052 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 351/705] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:20 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:20.617925 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3acd4660-8ed7-4159-a4dd-581c68c5dd66 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:20.619075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3acd4660-8ed7-4159-a4dd-581c68c5dd66 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:20.625550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3acd4660-8ed7-4159-a4dd-581c68c5dd66 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:20.626014 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3acd4660-8ed7-4159-a4dd-581c68c5dd66 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:20.626439 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3acd4660-8ed7-4159-a4dd-581c68c5dd66 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:20.627161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3acd4660-8ed7-4159-a4dd-581c68c5dd66 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:20.627720 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3acd4660-8ed7-4159-a4dd-581c68c5dd66 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:20.627963 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3acd4660-8ed7-4159-a4dd-581c68c5dd66 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:20.772255 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3acd4660-8ed7-4159-a4dd-581c68c5dd66 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:20.781762 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3acd4660-8ed7-4159-a4dd-581c68c5dd66 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:20.783177 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3acd4660-8ed7-4159-a4dd-581c68c5dd66 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:20.784338 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3acd4660-8ed7-4159-a4dd-581c68c5dd66 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.170423 Sep 06 21:19:20.784960 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 355/706] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:20 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:21.603651 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-397e8494-db54-4b6e-89f8-2590c4140ce2 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:21.604607 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-397e8494-db54-4b6e-89f8-2590c4140ce2 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:21.610992 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-397e8494-db54-4b6e-89f8-2590c4140ce2 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:21.611621 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-397e8494-db54-4b6e-89f8-2590c4140ce2 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:21.612054 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-397e8494-db54-4b6e-89f8-2590c4140ce2 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:21.612995 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-397e8494-db54-4b6e-89f8-2590c4140ce2 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:21.613446 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-397e8494-db54-4b6e-89f8-2590c4140ce2 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:21.613895 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-397e8494-db54-4b6e-89f8-2590c4140ce2 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:21.723892 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-397e8494-db54-4b6e-89f8-2590c4140ce2 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:21.732444 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-397e8494-db54-4b6e-89f8-2590c4140ce2 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1471 microversion: 2.1 time: 0.133034 Sep 06 21:19:21.744454 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 352/707] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:21 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1471 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:21.810349 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eda46a01-1cd7-4e39-be0f-753638057d19 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:21.811127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eda46a01-1cd7-4e39-be0f-753638057d19 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:21.816578 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-3beeaac4-9b50-4219-8540-b5c5f0c50110 req-e967b979-15e5-4bd4-808c-6c0873ac6986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0652742c-8554-4c35-89cd-8ff0fb44659f", "name": "network-vif-deleted", "tag": "d7f4717c-96be-4a44-bf93-cbe0186339a1"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:19:21.817704 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eda46a01-1cd7-4e39-be0f-753638057d19 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:21.818291 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eda46a01-1cd7-4e39-be0f-753638057d19 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:21.818821 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eda46a01-1cd7-4e39-be0f-753638057d19 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:21.819802 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eda46a01-1cd7-4e39-be0f-753638057d19 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:21.820354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eda46a01-1cd7-4e39-be0f-753638057d19 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:21.820915 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eda46a01-1cd7-4e39-be0f-753638057d19 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:21.831240 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3beeaac4-9b50-4219-8540-b5c5f0c50110 req-e967b979-15e5-4bd4-808c-6c0873ac6986 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:21.831716 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3beeaac4-9b50-4219-8540-b5c5f0c50110 req-e967b979-15e5-4bd4-808c-6c0873ac6986 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:21.832145 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3beeaac4-9b50-4219-8540-b5c5f0c50110 req-e967b979-15e5-4bd4-808c-6c0873ac6986 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:21.859017 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-3beeaac4-9b50-4219-8540-b5c5f0c50110 req-e967b979-15e5-4bd4-808c-6c0873ac6986 service nova] Creating event network-vif-deleted:d7f4717c-96be-4a44-bf93-cbe0186339a1 for instance 0652742c-8554-4c35-89cd-8ff0fb44659f on hv-cinder-74915 Sep 06 21:19:21.864198 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-3beeaac4-9b50-4219-8540-b5c5f0c50110 req-e967b979-15e5-4bd4-808c-6c0873ac6986 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122291 Sep 06 21:19:21.865004 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 356/708] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 21:19:21.977321 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-eda46a01-1cd7-4e39-be0f-753638057d19 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:21.992401 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-eda46a01-1cd7-4e39-be0f-753638057d19 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:21.995811 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-eda46a01-1cd7-4e39-be0f-753638057d19 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:21.997445 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eda46a01-1cd7-4e39-be0f-753638057d19 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.190943 Sep 06 21:19:21.998342 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 353/709] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:21 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 21:19:22.759560 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d7aa73c1-0e4e-4e8a-8a76-62e7dcaaaf45 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:22.760796 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d7aa73c1-0e4e-4e8a-8a76-62e7dcaaaf45 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:22.767986 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7aa73c1-0e4e-4e8a-8a76-62e7dcaaaf45 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:22.768467 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7aa73c1-0e4e-4e8a-8a76-62e7dcaaaf45 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:22.768932 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7aa73c1-0e4e-4e8a-8a76-62e7dcaaaf45 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:22.769639 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7aa73c1-0e4e-4e8a-8a76-62e7dcaaaf45 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:22.770091 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7aa73c1-0e4e-4e8a-8a76-62e7dcaaaf45 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:22.770558 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7aa73c1-0e4e-4e8a-8a76-62e7dcaaaf45 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:22.803168 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7aa73c1-0e4e-4e8a-8a76-62e7dcaaaf45 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:22.803651 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7aa73c1-0e4e-4e8a-8a76-62e7dcaaaf45 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:22.804127 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7aa73c1-0e4e-4e8a-8a76-62e7dcaaaf45 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:22.804566 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-d7aa73c1-0e4e-4e8a-8a76-62e7dcaaaf45 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lazy-loading 'fault' on Instance uuid 0652742c-8554-4c35-89cd-8ff0fb44659f {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:19:22.808109 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:19:22.854569 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d7aa73c1-0e4e-4e8a-8a76-62e7dcaaaf45 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:22.865728 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d7aa73c1-0e4e-4e8a-8a76-62e7dcaaaf45 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1308 microversion: 2.1 time: 0.110955 Sep 06 21:19:22.880687 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 357/710] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:22 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1308 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:23.025079 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-112ec2f0-00b7-4d13-a6fe-1a8a8ed0f560 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:23.025709 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-112ec2f0-00b7-4d13-a6fe-1a8a8ed0f560 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:23.032369 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-112ec2f0-00b7-4d13-a6fe-1a8a8ed0f560 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:23.032904 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-112ec2f0-00b7-4d13-a6fe-1a8a8ed0f560 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:23.033330 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-112ec2f0-00b7-4d13-a6fe-1a8a8ed0f560 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:23.034050 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-112ec2f0-00b7-4d13-a6fe-1a8a8ed0f560 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:23.034492 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-112ec2f0-00b7-4d13-a6fe-1a8a8ed0f560 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:23.034902 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-112ec2f0-00b7-4d13-a6fe-1a8a8ed0f560 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:23.174766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-112ec2f0-00b7-4d13-a6fe-1a8a8ed0f560 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:23.184110 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-112ec2f0-00b7-4d13-a6fe-1a8a8ed0f560 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:23.185595 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-112ec2f0-00b7-4d13-a6fe-1a8a8ed0f560 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:23.186760 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-112ec2f0-00b7-4d13-a6fe-1a8a8ed0f560 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.166650 Sep 06 21:19:23.187317 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 354/711] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:23 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:23.893408 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2037c926-4818-4821-9d61-f38369bf3fc4 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:23.894250 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2037c926-4818-4821-9d61-f38369bf3fc4 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:23.904242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2037c926-4818-4821-9d61-f38369bf3fc4 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:23.904726 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2037c926-4818-4821-9d61-f38369bf3fc4 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:23.905186 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2037c926-4818-4821-9d61-f38369bf3fc4 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:23.905878 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2037c926-4818-4821-9d61-f38369bf3fc4 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:23.906322 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2037c926-4818-4821-9d61-f38369bf3fc4 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:23.906745 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2037c926-4818-4821-9d61-f38369bf3fc4 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:23.943516 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2037c926-4818-4821-9d61-f38369bf3fc4 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:23.943996 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2037c926-4818-4821-9d61-f38369bf3fc4 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:23.944429 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2037c926-4818-4821-9d61-f38369bf3fc4 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:23.944912 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-2037c926-4818-4821-9d61-f38369bf3fc4 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lazy-loading 'fault' on Instance uuid 0652742c-8554-4c35-89cd-8ff0fb44659f {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:19:23.990133 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2037c926-4818-4821-9d61-f38369bf3fc4 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:23.998793 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2037c926-4818-4821-9d61-f38369bf3fc4 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1308 microversion: 2.1 time: 0.111290 Sep 06 21:19:23.999382 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 358/712] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:23 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1308 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:24.215246 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7173f9de-578d-48c7-89e9-acfbe58161f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:24.216155 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7173f9de-578d-48c7-89e9-acfbe58161f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:24.225208 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7173f9de-578d-48c7-89e9-acfbe58161f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:24.226269 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7173f9de-578d-48c7-89e9-acfbe58161f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:24.226867 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7173f9de-578d-48c7-89e9-acfbe58161f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:24.227745 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7173f9de-578d-48c7-89e9-acfbe58161f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:24.228500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7173f9de-578d-48c7-89e9-acfbe58161f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:24.229315 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7173f9de-578d-48c7-89e9-acfbe58161f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:24.371028 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7173f9de-578d-48c7-89e9-acfbe58161f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:24.380256 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7173f9de-578d-48c7-89e9-acfbe58161f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:24.381734 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7173f9de-578d-48c7-89e9-acfbe58161f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:24.382935 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7173f9de-578d-48c7-89e9-acfbe58161f6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.173159 Sep 06 21:19:24.383702 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 355/713] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:24 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:25.021758 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-19ae92e9-d1cc-4fb6-8e8b-bc274105f065 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:25.023473 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-19ae92e9-d1cc-4fb6-8e8b-bc274105f065 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:25.031795 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19ae92e9-d1cc-4fb6-8e8b-bc274105f065 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:25.032763 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19ae92e9-d1cc-4fb6-8e8b-bc274105f065 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:25.033532 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19ae92e9-d1cc-4fb6-8e8b-bc274105f065 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:25.034292 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19ae92e9-d1cc-4fb6-8e8b-bc274105f065 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:25.034994 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19ae92e9-d1cc-4fb6-8e8b-bc274105f065 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:25.035393 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19ae92e9-d1cc-4fb6-8e8b-bc274105f065 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:25.068428 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19ae92e9-d1cc-4fb6-8e8b-bc274105f065 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:25.068943 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19ae92e9-d1cc-4fb6-8e8b-bc274105f065 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:25.069376 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19ae92e9-d1cc-4fb6-8e8b-bc274105f065 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:25.069828 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-19ae92e9-d1cc-4fb6-8e8b-bc274105f065 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lazy-loading 'fault' on Instance uuid 0652742c-8554-4c35-89cd-8ff0fb44659f {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:19:25.112161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-19ae92e9-d1cc-4fb6-8e8b-bc274105f065 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:25.121157 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-19ae92e9-d1cc-4fb6-8e8b-bc274105f065 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1308 microversion: 2.1 time: 0.103178 Sep 06 21:19:25.121737 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 359/714] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:25 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:25.409446 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0b5b6182-f75f-4800-aa2b-02d4d1a91564 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:25.410044 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0b5b6182-f75f-4800-aa2b-02d4d1a91564 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:25.417490 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b5b6182-f75f-4800-aa2b-02d4d1a91564 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:25.418072 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b5b6182-f75f-4800-aa2b-02d4d1a91564 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:25.418507 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b5b6182-f75f-4800-aa2b-02d4d1a91564 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:25.419316 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b5b6182-f75f-4800-aa2b-02d4d1a91564 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:25.419791 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b5b6182-f75f-4800-aa2b-02d4d1a91564 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:25.420306 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b5b6182-f75f-4800-aa2b-02d4d1a91564 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:25.564583 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0b5b6182-f75f-4800-aa2b-02d4d1a91564 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:25.573757 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0b5b6182-f75f-4800-aa2b-02d4d1a91564 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:25.575207 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0b5b6182-f75f-4800-aa2b-02d4d1a91564 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:25.576353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0b5b6182-f75f-4800-aa2b-02d4d1a91564 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.170977 Sep 06 21:19:25.576962 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 356/715] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:25 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:26.146908 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b8739a4f-f1c7-4c28-82ad-98e85b8adbc7 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:26.148433 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b8739a4f-f1c7-4c28-82ad-98e85b8adbc7 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:26.155827 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8739a4f-f1c7-4c28-82ad-98e85b8adbc7 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:26.156316 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8739a4f-f1c7-4c28-82ad-98e85b8adbc7 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:26.156842 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8739a4f-f1c7-4c28-82ad-98e85b8adbc7 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:26.157555 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8739a4f-f1c7-4c28-82ad-98e85b8adbc7 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:26.158003 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8739a4f-f1c7-4c28-82ad-98e85b8adbc7 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:26.158449 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8739a4f-f1c7-4c28-82ad-98e85b8adbc7 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:26.194387 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8739a4f-f1c7-4c28-82ad-98e85b8adbc7 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:26.194946 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8739a4f-f1c7-4c28-82ad-98e85b8adbc7 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:26.195486 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8739a4f-f1c7-4c28-82ad-98e85b8adbc7 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:26.195996 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-b8739a4f-f1c7-4c28-82ad-98e85b8adbc7 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lazy-loading 'fault' on Instance uuid 0652742c-8554-4c35-89cd-8ff0fb44659f {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:19:26.243172 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b8739a4f-f1c7-4c28-82ad-98e85b8adbc7 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:26.251212 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b8739a4f-f1c7-4c28-82ad-98e85b8adbc7 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1308 microversion: 2.1 time: 0.109820 Sep 06 21:19:26.251786 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 360/716] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:26 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1308 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:26.602880 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6f3e37fd-404c-4cb5-982a-f85b80c918f3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:26.603485 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6f3e37fd-404c-4cb5-982a-f85b80c918f3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:26.610219 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f3e37fd-404c-4cb5-982a-f85b80c918f3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:26.610786 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f3e37fd-404c-4cb5-982a-f85b80c918f3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:26.611261 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f3e37fd-404c-4cb5-982a-f85b80c918f3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:26.611992 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f3e37fd-404c-4cb5-982a-f85b80c918f3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:26.612469 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f3e37fd-404c-4cb5-982a-f85b80c918f3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:26.612932 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f3e37fd-404c-4cb5-982a-f85b80c918f3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:26.766497 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6f3e37fd-404c-4cb5-982a-f85b80c918f3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:26.775431 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6f3e37fd-404c-4cb5-982a-f85b80c918f3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:26.777045 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6f3e37fd-404c-4cb5-982a-f85b80c918f3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:26.778208 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6f3e37fd-404c-4cb5-982a-f85b80c918f3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.179279 Sep 06 21:19:26.778737 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 357/717] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:26 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:27.277910 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-34479fbd-3a26-4798-a9d6-5e6f2a7380ab tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:27.278678 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-34479fbd-3a26-4798-a9d6-5e6f2a7380ab tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:27.286070 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34479fbd-3a26-4798-a9d6-5e6f2a7380ab tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:27.286549 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34479fbd-3a26-4798-a9d6-5e6f2a7380ab tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:27.286978 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34479fbd-3a26-4798-a9d6-5e6f2a7380ab tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:27.287679 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34479fbd-3a26-4798-a9d6-5e6f2a7380ab tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:27.288119 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34479fbd-3a26-4798-a9d6-5e6f2a7380ab tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:27.288536 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34479fbd-3a26-4798-a9d6-5e6f2a7380ab tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:27.323319 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34479fbd-3a26-4798-a9d6-5e6f2a7380ab tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:27.323756 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34479fbd-3a26-4798-a9d6-5e6f2a7380ab tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:27.324190 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34479fbd-3a26-4798-a9d6-5e6f2a7380ab tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:27.324718 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-34479fbd-3a26-4798-a9d6-5e6f2a7380ab tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lazy-loading 'fault' on Instance uuid 0652742c-8554-4c35-89cd-8ff0fb44659f {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:19:27.369582 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-34479fbd-3a26-4798-a9d6-5e6f2a7380ab tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:27.378495 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-34479fbd-3a26-4798-a9d6-5e6f2a7380ab tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1308 microversion: 2.1 time: 0.107868 Sep 06 21:19:27.384715 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 361/718] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:27 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1308 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:27.815135 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d34fd36a-9601-4249-9345-e6840a4e3de9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:27.815888 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d34fd36a-9601-4249-9345-e6840a4e3de9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:27.823658 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d34fd36a-9601-4249-9345-e6840a4e3de9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:27.824139 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d34fd36a-9601-4249-9345-e6840a4e3de9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:27.824564 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d34fd36a-9601-4249-9345-e6840a4e3de9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:27.825360 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d34fd36a-9601-4249-9345-e6840a4e3de9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:27.825813 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d34fd36a-9601-4249-9345-e6840a4e3de9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:27.826228 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d34fd36a-9601-4249-9345-e6840a4e3de9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:27.832107 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:19:27.970302 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d34fd36a-9601-4249-9345-e6840a4e3de9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:27.980061 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d34fd36a-9601-4249-9345-e6840a4e3de9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:27.981551 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d34fd36a-9601-4249-9345-e6840a4e3de9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:27.982769 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d34fd36a-9601-4249-9345-e6840a4e3de9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.173106 Sep 06 21:19:27.983536 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 358/719] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:27 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:28.401934 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4c6b37c5-a879-41c8-b39b-435e142f8f23 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:28.402633 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4c6b37c5-a879-41c8-b39b-435e142f8f23 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:28.405150 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:19:28.411697 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c6b37c5-a879-41c8-b39b-435e142f8f23 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:28.412167 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c6b37c5-a879-41c8-b39b-435e142f8f23 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:28.412591 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c6b37c5-a879-41c8-b39b-435e142f8f23 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:28.413332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c6b37c5-a879-41c8-b39b-435e142f8f23 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:28.413772 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c6b37c5-a879-41c8-b39b-435e142f8f23 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:28.414324 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c6b37c5-a879-41c8-b39b-435e142f8f23 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:28.449845 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c6b37c5-a879-41c8-b39b-435e142f8f23 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:28.450724 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c6b37c5-a879-41c8-b39b-435e142f8f23 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:28.451160 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c6b37c5-a879-41c8-b39b-435e142f8f23 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:28.451644 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-4c6b37c5-a879-41c8-b39b-435e142f8f23 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lazy-loading 'fault' on Instance uuid 0652742c-8554-4c35-89cd-8ff0fb44659f {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:19:28.496919 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4c6b37c5-a879-41c8-b39b-435e142f8f23 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:28.504953 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4c6b37c5-a879-41c8-b39b-435e142f8f23 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1308 microversion: 2.1 time: 0.107035 Sep 06 21:19:28.505557 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 362/720] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:28 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:29.009772 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7580df5a-f140-4d5e-be87-68d1502342ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:29.010396 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7580df5a-f140-4d5e-be87-68d1502342ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:29.017439 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7580df5a-f140-4d5e-be87-68d1502342ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:29.017885 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7580df5a-f140-4d5e-be87-68d1502342ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:29.018343 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7580df5a-f140-4d5e-be87-68d1502342ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:29.019038 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7580df5a-f140-4d5e-be87-68d1502342ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:29.019449 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7580df5a-f140-4d5e-be87-68d1502342ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:29.019889 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7580df5a-f140-4d5e-be87-68d1502342ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:29.161537 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7580df5a-f140-4d5e-be87-68d1502342ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:29.170418 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7580df5a-f140-4d5e-be87-68d1502342ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:29.171855 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7580df5a-f140-4d5e-be87-68d1502342ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:29.173382 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7580df5a-f140-4d5e-be87-68d1502342ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.167215 Sep 06 21:19:29.173931 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 359/721] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:29 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:29.530933 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-32c94dd1-5c5f-448b-8bf9-b8738f46ba33 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:29.532019 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-32c94dd1-5c5f-448b-8bf9-b8738f46ba33 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:29.539583 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32c94dd1-5c5f-448b-8bf9-b8738f46ba33 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:29.540201 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32c94dd1-5c5f-448b-8bf9-b8738f46ba33 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:29.540780 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32c94dd1-5c5f-448b-8bf9-b8738f46ba33 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:29.541542 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32c94dd1-5c5f-448b-8bf9-b8738f46ba33 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:29.542011 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32c94dd1-5c5f-448b-8bf9-b8738f46ba33 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:29.542424 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32c94dd1-5c5f-448b-8bf9-b8738f46ba33 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:29.577056 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32c94dd1-5c5f-448b-8bf9-b8738f46ba33 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:29.577542 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32c94dd1-5c5f-448b-8bf9-b8738f46ba33 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:29.577968 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-32c94dd1-5c5f-448b-8bf9-b8738f46ba33 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:29.578423 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-32c94dd1-5c5f-448b-8bf9-b8738f46ba33 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lazy-loading 'fault' on Instance uuid 0652742c-8554-4c35-89cd-8ff0fb44659f {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:19:29.621649 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-32c94dd1-5c5f-448b-8bf9-b8738f46ba33 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:29.630077 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-32c94dd1-5c5f-448b-8bf9-b8738f46ba33 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1308 microversion: 2.1 time: 0.104983 Sep 06 21:19:29.630865 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 363/722] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:29 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1308 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:30.201170 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aca1984a-247a-4077-be4b-d25c02f1d348 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:30.201865 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-aca1984a-247a-4077-be4b-d25c02f1d348 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:30.203619 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=60 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:19:30.209494 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aca1984a-247a-4077-be4b-d25c02f1d348 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:30.209969 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aca1984a-247a-4077-be4b-d25c02f1d348 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:30.210391 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aca1984a-247a-4077-be4b-d25c02f1d348 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:30.211107 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aca1984a-247a-4077-be4b-d25c02f1d348 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:30.211550 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aca1984a-247a-4077-be4b-d25c02f1d348 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:30.211961 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aca1984a-247a-4077-be4b-d25c02f1d348 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:30.349266 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-aca1984a-247a-4077-be4b-d25c02f1d348 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:30.358252 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-aca1984a-247a-4077-be4b-d25c02f1d348 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:30.359781 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-aca1984a-247a-4077-be4b-d25c02f1d348 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:30.361015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-aca1984a-247a-4077-be4b-d25c02f1d348 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.164584 Sep 06 21:19:30.372709 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 360/723] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:30 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:30.653193 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9a05760d-332d-485b-94aa-3e8465746836 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:30.653824 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9a05760d-332d-485b-94aa-3e8465746836 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:30.662269 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a05760d-332d-485b-94aa-3e8465746836 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:30.663217 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a05760d-332d-485b-94aa-3e8465746836 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:30.665312 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a05760d-332d-485b-94aa-3e8465746836 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:30.666141 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a05760d-332d-485b-94aa-3e8465746836 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:30.666646 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a05760d-332d-485b-94aa-3e8465746836 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:30.667084 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a05760d-332d-485b-94aa-3e8465746836 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:30.707098 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a05760d-332d-485b-94aa-3e8465746836 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:30.707581 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a05760d-332d-485b-94aa-3e8465746836 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:30.708014 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9a05760d-332d-485b-94aa-3e8465746836 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:30.708472 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-9a05760d-332d-485b-94aa-3e8465746836 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lazy-loading 'fault' on Instance uuid 0652742c-8554-4c35-89cd-8ff0fb44659f {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:19:30.756493 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9a05760d-332d-485b-94aa-3e8465746836 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:30.765704 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9a05760d-332d-485b-94aa-3e8465746836 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1308 microversion: 2.1 time: 0.116710 Sep 06 21:19:30.766570 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 364/724] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:30 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1308 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:31.396489 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-880373b3-9a2b-4d8b-8299-ca933a57d2f3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:31.397970 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-880373b3-9a2b-4d8b-8299-ca933a57d2f3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:31.409286 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-880373b3-9a2b-4d8b-8299-ca933a57d2f3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:31.410085 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-880373b3-9a2b-4d8b-8299-ca933a57d2f3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:31.410782 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-880373b3-9a2b-4d8b-8299-ca933a57d2f3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:31.411943 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-880373b3-9a2b-4d8b-8299-ca933a57d2f3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:31.412726 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-880373b3-9a2b-4d8b-8299-ca933a57d2f3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:31.413437 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-880373b3-9a2b-4d8b-8299-ca933a57d2f3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:31.559671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-880373b3-9a2b-4d8b-8299-ca933a57d2f3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:31.568586 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-880373b3-9a2b-4d8b-8299-ca933a57d2f3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:31.570035 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-880373b3-9a2b-4d8b-8299-ca933a57d2f3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:31.571853 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-880373b3-9a2b-4d8b-8299-ca933a57d2f3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.186404 Sep 06 21:19:31.572861 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 361/725] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:31 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:31.789052 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ba91eebe-09e8-47a2-a2f7-d21e6774d6fd tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:31.789699 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ba91eebe-09e8-47a2-a2f7-d21e6774d6fd tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:31.798511 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba91eebe-09e8-47a2-a2f7-d21e6774d6fd tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:31.799127 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba91eebe-09e8-47a2-a2f7-d21e6774d6fd tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:31.799692 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba91eebe-09e8-47a2-a2f7-d21e6774d6fd tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:31.800627 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba91eebe-09e8-47a2-a2f7-d21e6774d6fd tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:31.801369 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba91eebe-09e8-47a2-a2f7-d21e6774d6fd tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:31.801902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba91eebe-09e8-47a2-a2f7-d21e6774d6fd tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:31.835884 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba91eebe-09e8-47a2-a2f7-d21e6774d6fd tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:31.836362 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba91eebe-09e8-47a2-a2f7-d21e6774d6fd tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:31.836834 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ba91eebe-09e8-47a2-a2f7-d21e6774d6fd tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:31.837290 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-ba91eebe-09e8-47a2-a2f7-d21e6774d6fd tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lazy-loading 'fault' on Instance uuid 0652742c-8554-4c35-89cd-8ff0fb44659f {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:19:31.882015 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ba91eebe-09e8-47a2-a2f7-d21e6774d6fd tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:31.890195 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ba91eebe-09e8-47a2-a2f7-d21e6774d6fd tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1308 microversion: 2.1 time: 0.105194 Sep 06 21:19:31.890770 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 365/726] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:31 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:32.598006 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ce1b09bc-c3b1-401a-852a-abaa87f6dcd4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:32.599445 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ce1b09bc-c3b1-401a-852a-abaa87f6dcd4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:32.607433 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce1b09bc-c3b1-401a-852a-abaa87f6dcd4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:32.607996 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce1b09bc-c3b1-401a-852a-abaa87f6dcd4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:32.608511 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce1b09bc-c3b1-401a-852a-abaa87f6dcd4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:32.609320 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce1b09bc-c3b1-401a-852a-abaa87f6dcd4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:32.609814 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce1b09bc-c3b1-401a-852a-abaa87f6dcd4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:32.610300 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce1b09bc-c3b1-401a-852a-abaa87f6dcd4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:32.750917 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ce1b09bc-c3b1-401a-852a-abaa87f6dcd4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:32.759569 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ce1b09bc-c3b1-401a-852a-abaa87f6dcd4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:32.761170 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ce1b09bc-c3b1-401a-852a-abaa87f6dcd4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:32.762238 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ce1b09bc-c3b1-401a-852a-abaa87f6dcd4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.168207 Sep 06 21:19:32.762868 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 362/727] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:32 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:32.913371 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0e398765-2dd3-48fc-ad76-a7e458e3e6bd tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:32.914036 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0e398765-2dd3-48fc-ad76-a7e458e3e6bd tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:32.921466 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e398765-2dd3-48fc-ad76-a7e458e3e6bd tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:32.921950 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e398765-2dd3-48fc-ad76-a7e458e3e6bd tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:32.922391 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e398765-2dd3-48fc-ad76-a7e458e3e6bd tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:32.923442 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e398765-2dd3-48fc-ad76-a7e458e3e6bd tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:32.923905 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e398765-2dd3-48fc-ad76-a7e458e3e6bd tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:32.924368 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e398765-2dd3-48fc-ad76-a7e458e3e6bd tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:32.958192 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e398765-2dd3-48fc-ad76-a7e458e3e6bd tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:32.958725 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e398765-2dd3-48fc-ad76-a7e458e3e6bd tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:32.959103 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e398765-2dd3-48fc-ad76-a7e458e3e6bd tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:32.959562 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-0e398765-2dd3-48fc-ad76-a7e458e3e6bd tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lazy-loading 'fault' on Instance uuid 0652742c-8554-4c35-89cd-8ff0fb44659f {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:19:33.006671 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0e398765-2dd3-48fc-ad76-a7e458e3e6bd tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:33.015452 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0e398765-2dd3-48fc-ad76-a7e458e3e6bd tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1308 microversion: 2.1 time: 0.105879 Sep 06 21:19:33.016292 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 366/728] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:32 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:33.788811 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c199778d-d0b0-4db2-962a-118f0826e1ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:33.789432 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c199778d-d0b0-4db2-962a-118f0826e1ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:33.796436 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c199778d-d0b0-4db2-962a-118f0826e1ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:33.796955 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c199778d-d0b0-4db2-962a-118f0826e1ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:33.797392 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c199778d-d0b0-4db2-962a-118f0826e1ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:33.798447 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c199778d-d0b0-4db2-962a-118f0826e1ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:33.798893 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c199778d-d0b0-4db2-962a-118f0826e1ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:33.799311 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c199778d-d0b0-4db2-962a-118f0826e1ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:33.943256 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c199778d-d0b0-4db2-962a-118f0826e1ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:33.953114 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c199778d-d0b0-4db2-962a-118f0826e1ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:33.954677 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c199778d-d0b0-4db2-962a-118f0826e1ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:33.955847 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c199778d-d0b0-4db2-962a-118f0826e1ae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.171105 Sep 06 21:19:33.956386 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 363/729] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:33 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:34.039003 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cb63b68d-60fb-4fd0-ad9e-4c82738762d8 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:34.039592 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cb63b68d-60fb-4fd0-ad9e-4c82738762d8 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:34.046584 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb63b68d-60fb-4fd0-ad9e-4c82738762d8 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:34.047064 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb63b68d-60fb-4fd0-ad9e-4c82738762d8 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:34.047496 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb63b68d-60fb-4fd0-ad9e-4c82738762d8 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:34.048540 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb63b68d-60fb-4fd0-ad9e-4c82738762d8 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:34.049027 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb63b68d-60fb-4fd0-ad9e-4c82738762d8 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:34.049453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb63b68d-60fb-4fd0-ad9e-4c82738762d8 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:34.081133 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb63b68d-60fb-4fd0-ad9e-4c82738762d8 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:34.081606 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb63b68d-60fb-4fd0-ad9e-4c82738762d8 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:34.082035 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb63b68d-60fb-4fd0-ad9e-4c82738762d8 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:34.082481 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-cb63b68d-60fb-4fd0-ad9e-4c82738762d8 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lazy-loading 'fault' on Instance uuid 0652742c-8554-4c35-89cd-8ff0fb44659f {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:19:34.125526 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-cb63b68d-60fb-4fd0-ad9e-4c82738762d8 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:34.133845 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cb63b68d-60fb-4fd0-ad9e-4c82738762d8 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1308 microversion: 2.1 time: 0.098729 Sep 06 21:19:34.134433 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 367/730] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:34 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:34.982032 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1bbdd50b-9bb7-4c97-b752-cbfcfbe79617 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:34.982658 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1bbdd50b-9bb7-4c97-b752-cbfcfbe79617 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:34.992139 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1bbdd50b-9bb7-4c97-b752-cbfcfbe79617 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:34.992628 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1bbdd50b-9bb7-4c97-b752-cbfcfbe79617 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:34.993374 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1bbdd50b-9bb7-4c97-b752-cbfcfbe79617 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:34.994158 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1bbdd50b-9bb7-4c97-b752-cbfcfbe79617 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:34.994625 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1bbdd50b-9bb7-4c97-b752-cbfcfbe79617 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:34.995045 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1bbdd50b-9bb7-4c97-b752-cbfcfbe79617 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:35.141105 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1bbdd50b-9bb7-4c97-b752-cbfcfbe79617 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:35.149739 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1bbdd50b-9bb7-4c97-b752-cbfcfbe79617 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:35.151203 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1bbdd50b-9bb7-4c97-b752-cbfcfbe79617 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:35.152389 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1bbdd50b-9bb7-4c97-b752-cbfcfbe79617 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.174905 Sep 06 21:19:35.152971 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 364/731] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:34 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:35.156624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dfb57e5a-2234-4b11-ade7-944a41513939 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:35.157409 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dfb57e5a-2234-4b11-ade7-944a41513939 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:35.163851 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfb57e5a-2234-4b11-ade7-944a41513939 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:35.164322 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfb57e5a-2234-4b11-ade7-944a41513939 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:35.164798 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfb57e5a-2234-4b11-ade7-944a41513939 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:35.165478 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfb57e5a-2234-4b11-ade7-944a41513939 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:35.165924 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfb57e5a-2234-4b11-ade7-944a41513939 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:35.166343 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfb57e5a-2234-4b11-ade7-944a41513939 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:35.200869 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfb57e5a-2234-4b11-ade7-944a41513939 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:35.201351 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfb57e5a-2234-4b11-ade7-944a41513939 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:35.201778 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dfb57e5a-2234-4b11-ade7-944a41513939 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:35.202229 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-dfb57e5a-2234-4b11-ade7-944a41513939 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lazy-loading 'fault' on Instance uuid 0652742c-8554-4c35-89cd-8ff0fb44659f {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:19:35.242709 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-dfb57e5a-2234-4b11-ade7-944a41513939 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:35.250667 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dfb57e5a-2234-4b11-ade7-944a41513939 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1308 microversion: 2.1 time: 0.098002 Sep 06 21:19:35.251220 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 368/732] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:35 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:36.182783 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-91b26dfd-b8fe-4074-8a23-1df567feb312 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:36.183791 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-91b26dfd-b8fe-4074-8a23-1df567feb312 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:36.194715 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91b26dfd-b8fe-4074-8a23-1df567feb312 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:36.195539 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91b26dfd-b8fe-4074-8a23-1df567feb312 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:36.196282 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91b26dfd-b8fe-4074-8a23-1df567feb312 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:36.197546 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91b26dfd-b8fe-4074-8a23-1df567feb312 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:36.198389 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91b26dfd-b8fe-4074-8a23-1df567feb312 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:36.199129 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91b26dfd-b8fe-4074-8a23-1df567feb312 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:36.273895 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b8b74b99-75fb-4a56-bb65-f575df38c1d9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:36.274552 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b8b74b99-75fb-4a56-bb65-f575df38c1d9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:36.284193 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8b74b99-75fb-4a56-bb65-f575df38c1d9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:36.284816 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8b74b99-75fb-4a56-bb65-f575df38c1d9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:36.285264 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8b74b99-75fb-4a56-bb65-f575df38c1d9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:36.285981 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8b74b99-75fb-4a56-bb65-f575df38c1d9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:36.286850 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8b74b99-75fb-4a56-bb65-f575df38c1d9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:36.286850 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8b74b99-75fb-4a56-bb65-f575df38c1d9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:36.322584 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8b74b99-75fb-4a56-bb65-f575df38c1d9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:36.323063 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8b74b99-75fb-4a56-bb65-f575df38c1d9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:36.323567 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b8b74b99-75fb-4a56-bb65-f575df38c1d9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:36.323930 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-b8b74b99-75fb-4a56-bb65-f575df38c1d9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lazy-loading 'fault' on Instance uuid 0652742c-8554-4c35-89cd-8ff0fb44659f {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:19:36.339656 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-91b26dfd-b8fe-4074-8a23-1df567feb312 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:36.348606 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-91b26dfd-b8fe-4074-8a23-1df567feb312 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:36.350068 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-91b26dfd-b8fe-4074-8a23-1df567feb312 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:36.351220 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-91b26dfd-b8fe-4074-8a23-1df567feb312 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.175436 Sep 06 21:19:36.351783 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 365/733] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:36 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:36.366254 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b8b74b99-75fb-4a56-bb65-f575df38c1d9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:36.374903 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b8b74b99-75fb-4a56-bb65-f575df38c1d9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1308 microversion: 2.1 time: 0.104958 Sep 06 21:19:36.375490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 369/734] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:36 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1308 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:37.382889 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6a4c1a1f-1b73-4556-925c-070a7cfe8f60 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:37.383970 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6a4c1a1f-1b73-4556-925c-070a7cfe8f60 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:37.392014 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a4c1a1f-1b73-4556-925c-070a7cfe8f60 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:37.392495 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a4c1a1f-1b73-4556-925c-070a7cfe8f60 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:37.392990 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a4c1a1f-1b73-4556-925c-070a7cfe8f60 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:37.393686 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a4c1a1f-1b73-4556-925c-070a7cfe8f60 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:37.394127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a4c1a1f-1b73-4556-925c-070a7cfe8f60 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:37.394544 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a4c1a1f-1b73-4556-925c-070a7cfe8f60 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:37.397658 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dc80a155-fa79-4411-b532-ad6e78ff6e74 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:37.399720 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dc80a155-fa79-4411-b532-ad6e78ff6e74 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:37.406017 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc80a155-fa79-4411-b532-ad6e78ff6e74 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:37.406499 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc80a155-fa79-4411-b532-ad6e78ff6e74 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:37.406937 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc80a155-fa79-4411-b532-ad6e78ff6e74 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:37.407634 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc80a155-fa79-4411-b532-ad6e78ff6e74 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:37.408092 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc80a155-fa79-4411-b532-ad6e78ff6e74 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:37.408516 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc80a155-fa79-4411-b532-ad6e78ff6e74 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:37.412896 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:19:37.442487 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc80a155-fa79-4411-b532-ad6e78ff6e74 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:37.442999 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc80a155-fa79-4411-b532-ad6e78ff6e74 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:37.443435 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc80a155-fa79-4411-b532-ad6e78ff6e74 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:37.443891 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-dc80a155-fa79-4411-b532-ad6e78ff6e74 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lazy-loading 'fault' on Instance uuid 0652742c-8554-4c35-89cd-8ff0fb44659f {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:19:37.497203 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-dc80a155-fa79-4411-b532-ad6e78ff6e74 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:37.505316 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dc80a155-fa79-4411-b532-ad6e78ff6e74 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1308 microversion: 2.1 time: 0.111522 Sep 06 21:19:37.505903 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 370/735] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:37 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1308 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:37.532824 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6a4c1a1f-1b73-4556-925c-070a7cfe8f60 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:37.542613 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6a4c1a1f-1b73-4556-925c-070a7cfe8f60 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:37.543165 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6a4c1a1f-1b73-4556-925c-070a7cfe8f60 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:37.544329 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6a4c1a1f-1b73-4556-925c-070a7cfe8f60 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.168178 Sep 06 21:19:37.544919 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 366/736] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:37 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:38.530046 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4016f9c0-ae07-4969-ac8a-dc2732f07ceb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:38.530688 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4016f9c0-ae07-4969-ac8a-dc2732f07ceb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:38.537636 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4016f9c0-ae07-4969-ac8a-dc2732f07ceb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:38.538117 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4016f9c0-ae07-4969-ac8a-dc2732f07ceb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:38.538551 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4016f9c0-ae07-4969-ac8a-dc2732f07ceb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:38.539251 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4016f9c0-ae07-4969-ac8a-dc2732f07ceb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:38.539727 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4016f9c0-ae07-4969-ac8a-dc2732f07ceb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:38.540130 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4016f9c0-ae07-4969-ac8a-dc2732f07ceb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:38.570627 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6107d07e-9d16-4d89-a0f2-977e48aebeca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:38.571229 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6107d07e-9d16-4d89-a0f2-977e48aebeca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:38.571965 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4016f9c0-ae07-4969-ac8a-dc2732f07ceb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:38.572449 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4016f9c0-ae07-4969-ac8a-dc2732f07ceb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:38.572913 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4016f9c0-ae07-4969-ac8a-dc2732f07ceb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:38.573364 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-4016f9c0-ae07-4969-ac8a-dc2732f07ceb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lazy-loading 'fault' on Instance uuid 0652742c-8554-4c35-89cd-8ff0fb44659f {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:19:38.577683 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6107d07e-9d16-4d89-a0f2-977e48aebeca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:38.578148 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6107d07e-9d16-4d89-a0f2-977e48aebeca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:38.578550 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6107d07e-9d16-4d89-a0f2-977e48aebeca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:38.579246 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6107d07e-9d16-4d89-a0f2-977e48aebeca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:38.579688 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6107d07e-9d16-4d89-a0f2-977e48aebeca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:38.580095 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6107d07e-9d16-4d89-a0f2-977e48aebeca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:38.614234 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4016f9c0-ae07-4969-ac8a-dc2732f07ceb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:38.622890 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4016f9c0-ae07-4969-ac8a-dc2732f07ceb tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1308 microversion: 2.1 time: 0.097478 Sep 06 21:19:38.624580 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 371/737] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:38 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:38.721452 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6107d07e-9d16-4d89-a0f2-977e48aebeca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:38.730926 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6107d07e-9d16-4d89-a0f2-977e48aebeca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:38.732397 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6107d07e-9d16-4d89-a0f2-977e48aebeca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:38.733592 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6107d07e-9d16-4d89-a0f2-977e48aebeca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.166836 Sep 06 21:19:38.734152 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 367/738] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:38 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 21:19:39.650151 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1847ab98-fc86-4959-85ab-57bcf62fed79 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:39.651149 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1847ab98-fc86-4959-85ab-57bcf62fed79 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:39.662331 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1847ab98-fc86-4959-85ab-57bcf62fed79 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:39.663122 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1847ab98-fc86-4959-85ab-57bcf62fed79 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:39.663837 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1847ab98-fc86-4959-85ab-57bcf62fed79 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:39.665069 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1847ab98-fc86-4959-85ab-57bcf62fed79 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:39.665817 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1847ab98-fc86-4959-85ab-57bcf62fed79 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:39.666487 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1847ab98-fc86-4959-85ab-57bcf62fed79 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:39.699817 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1847ab98-fc86-4959-85ab-57bcf62fed79 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:39.700290 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1847ab98-fc86-4959-85ab-57bcf62fed79 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:39.700709 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1847ab98-fc86-4959-85ab-57bcf62fed79 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:39.701185 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-1847ab98-fc86-4959-85ab-57bcf62fed79 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lazy-loading 'fault' on Instance uuid 0652742c-8554-4c35-89cd-8ff0fb44659f {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:19:39.744024 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1847ab98-fc86-4959-85ab-57bcf62fed79 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:39.752354 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1847ab98-fc86-4959-85ab-57bcf62fed79 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1308 microversion: 2.1 time: 0.108822 Sep 06 21:19:39.752930 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 372/739] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:39 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1308 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:39.759360 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-56874483-d171-4a3a-9f0d-404e85062936 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:39.759968 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-56874483-d171-4a3a-9f0d-404e85062936 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:39.766983 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56874483-d171-4a3a-9f0d-404e85062936 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:39.767463 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56874483-d171-4a3a-9f0d-404e85062936 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:39.767917 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56874483-d171-4a3a-9f0d-404e85062936 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:39.768639 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56874483-d171-4a3a-9f0d-404e85062936 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:39.769130 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56874483-d171-4a3a-9f0d-404e85062936 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:39.769542 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56874483-d171-4a3a-9f0d-404e85062936 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:39.923465 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-56874483-d171-4a3a-9f0d-404e85062936 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:39.936725 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-56874483-d171-4a3a-9f0d-404e85062936 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:39.938981 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-56874483-d171-4a3a-9f0d-404e85062936 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:39.940500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-56874483-d171-4a3a-9f0d-404e85062936 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.184949 Sep 06 21:19:39.941316 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 368/740] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:39 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:40.778818 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7edff56b-3773-457f-88da-026b27a7557a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:40.779715 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7edff56b-3773-457f-88da-026b27a7557a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:40.786589 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7edff56b-3773-457f-88da-026b27a7557a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:40.787073 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7edff56b-3773-457f-88da-026b27a7557a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:40.787511 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7edff56b-3773-457f-88da-026b27a7557a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:40.788210 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7edff56b-3773-457f-88da-026b27a7557a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:40.788686 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7edff56b-3773-457f-88da-026b27a7557a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:40.789121 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7edff56b-3773-457f-88da-026b27a7557a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:40.820289 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7edff56b-3773-457f-88da-026b27a7557a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:40.820791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7edff56b-3773-457f-88da-026b27a7557a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:40.821230 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7edff56b-3773-457f-88da-026b27a7557a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:40.821675 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-7edff56b-3773-457f-88da-026b27a7557a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lazy-loading 'fault' on Instance uuid 0652742c-8554-4c35-89cd-8ff0fb44659f {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:19:40.863699 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7edff56b-3773-457f-88da-026b27a7557a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:40.874757 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7edff56b-3773-457f-88da-026b27a7557a tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1308 microversion: 2.1 time: 0.101812 Sep 06 21:19:40.875318 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 373/741] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:40 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:40.969082 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-11825872-af08-4d0f-9388-095f4f33db3b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:40.969668 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-11825872-af08-4d0f-9388-095f4f33db3b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:40.976542 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11825872-af08-4d0f-9388-095f4f33db3b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:40.977057 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11825872-af08-4d0f-9388-095f4f33db3b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:40.977484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11825872-af08-4d0f-9388-095f4f33db3b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:40.978163 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11825872-af08-4d0f-9388-095f4f33db3b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:40.978622 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11825872-af08-4d0f-9388-095f4f33db3b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:40.979131 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11825872-af08-4d0f-9388-095f4f33db3b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:41.120970 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-11825872-af08-4d0f-9388-095f4f33db3b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:41.132079 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-11825872-af08-4d0f-9388-095f4f33db3b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:41.133543 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-11825872-af08-4d0f-9388-095f4f33db3b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:41.134845 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-11825872-af08-4d0f-9388-095f4f33db3b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.169915 Sep 06 21:19:41.135408 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 369/742] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:40 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:41.902498 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dd88221a-db4d-46ab-a3d5-67960d19bbd9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:41.903390 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dd88221a-db4d-46ab-a3d5-67960d19bbd9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:41.914228 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd88221a-db4d-46ab-a3d5-67960d19bbd9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:41.914986 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd88221a-db4d-46ab-a3d5-67960d19bbd9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:41.915740 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd88221a-db4d-46ab-a3d5-67960d19bbd9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:41.917189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd88221a-db4d-46ab-a3d5-67960d19bbd9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:41.917634 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd88221a-db4d-46ab-a3d5-67960d19bbd9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:41.918378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd88221a-db4d-46ab-a3d5-67960d19bbd9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:41.954996 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd88221a-db4d-46ab-a3d5-67960d19bbd9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:41.955466 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd88221a-db4d-46ab-a3d5-67960d19bbd9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:41.955891 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd88221a-db4d-46ab-a3d5-67960d19bbd9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:41.956336 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-dd88221a-db4d-46ab-a3d5-67960d19bbd9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lazy-loading 'fault' on Instance uuid 0652742c-8554-4c35-89cd-8ff0fb44659f {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:19:42.000350 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-dd88221a-db4d-46ab-a3d5-67960d19bbd9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0c39501bf48c2a63257a4cf75def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0901a228de4c59bc0e999f55bc1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:42.008330 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dd88221a-db4d-46ab-a3d5-67960d19bbd9 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 200 len: 1308 microversion: 2.1 time: 0.112771 Sep 06 21:19:42.008924 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 374/743] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:41 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 1308 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:19:42.165276 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7cecc1b8-9dc4-4377-9663-047f00af4926 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:42.166217 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7cecc1b8-9dc4-4377-9663-047f00af4926 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:42.175246 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cecc1b8-9dc4-4377-9663-047f00af4926 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:42.175730 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cecc1b8-9dc4-4377-9663-047f00af4926 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:42.176164 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cecc1b8-9dc4-4377-9663-047f00af4926 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:42.176921 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cecc1b8-9dc4-4377-9663-047f00af4926 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:42.177371 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cecc1b8-9dc4-4377-9663-047f00af4926 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:42.177791 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cecc1b8-9dc4-4377-9663-047f00af4926 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:42.315411 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7cecc1b8-9dc4-4377-9663-047f00af4926 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:42.328600 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7cecc1b8-9dc4-4377-9663-047f00af4926 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:42.330874 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7cecc1b8-9dc4-4377-9663-047f00af4926 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:42.332734 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7cecc1b8-9dc4-4377-9663-047f00af4926 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.173417 Sep 06 21:19:42.333540 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 370/744] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:42 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:43.032887 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1abd5f68-5493-49c6-a3c2-d35be5a3f7c1 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:43.033490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1abd5f68-5493-49c6-a3c2-d35be5a3f7c1 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] [instance: 0652742c-8554-4c35-89cd-8ff0fb44659f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:43.040421 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1abd5f68-5493-49c6-a3c2-d35be5a3f7c1 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:43.040950 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1abd5f68-5493-49c6-a3c2-d35be5a3f7c1 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:43.041387 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1abd5f68-5493-49c6-a3c2-d35be5a3f7c1 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:43.042119 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1abd5f68-5493-49c6-a3c2-d35be5a3f7c1 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:43.042573 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1abd5f68-5493-49c6-a3c2-d35be5a3f7c1 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:43.042999 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1abd5f68-5493-49c6-a3c2-d35be5a3f7c1 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:43.057359 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-1abd5f68-5493-49c6-a3c2-d35be5a3f7c1 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] HTTP exception thrown: Instance 0652742c-8554-4c35-89cd-8ff0fb44659f could not be found. Sep 06 21:19:43.059016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1abd5f68-5493-49c6-a3c2-d35be5a3f7c1 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Request method failure captured: Sep 06 21:19:43.059016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f HTTP/1.1 Sep 06 21:19:43.059016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:19:43.059016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:19:43.059016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:19:43.059016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:19:43.059016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:19:43.059016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:19:43.059016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:19:43.059016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:19:43.059016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7igQZvrWC8vVHP9plwV4Wm4s82bH3zhAOY2v51BD4VZyGweaT-ObbPB5XzgueD40khRimnscszz_hK5SMfyQUSGg8_3znU_4GDuQidHPsYqRWCklBLT3FT76tagBD-86PwMNxoNtEy12E9EEDgKDo3hctXFPUR5mcSI2UOXFjy3JBM Sep 06 21:19:43.059016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:19:43.059016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:19:43.059016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:19:43.059016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:19:43.059016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:19:43.059016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:19:43.059016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: 3c0901a228de4c59bc0e999f55bc1e08 Sep 06 21:19:43.059016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1243964682 Sep 06 21:19:43.059016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:19:43.059016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:19:43.060496 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3c0901a228de4c59bc0e999f55bc1e08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3c0901a228de4c59bc0e999f55bc1e08", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3c0901a228de4c59bc0e999f55bc1e08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3c0901a228de4c59bc0e999f55bc1e08"}]}] Sep 06 21:19:43.060496 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-VolumesSnapshotTestJSON-1243964682 Sep 06 21:19:43.060496 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 3c0901a228de4c59bc0e999f55bc1e08 Sep 06 21:19:43.060496 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1243964682 Sep 06 21:19:43.060496 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-VolumesSnapshotTestJSON-1243964682-project Sep 06 21:19:43.060496 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:19:43.060496 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:19:43.060496 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: 71e0c39501bf48c2a63257a4cf75def1 Sep 06 21:19:43.060496 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-VolumesSnapshotTestJSON-1243964682-project Sep 06 21:19:43.060496 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: > Sep 06 21:19:43.060496 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Instance 0652742c-8554-4c35-89cd-8ff0fb44659f could not be found. Sep 06 21:19:43.060496 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'id': '0652742c-8554-4c35-89cd-8ff0fb44659f'} Sep 06 21:19:43.061420 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:19:43.061420 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:19:43.061420 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:19:43.061420 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:19:43.061420 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:19:43.061420 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:19:43.061420 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:19:43.061420 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:19:43.061420 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:19:43.061420 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:19:43.061420 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0652742c-8554-4c35-89cd-8ff0fb44659f could not be found. Sep 06 21:19:43.061420 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:19:43.061420 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:19:43.061420 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:19:43.061420 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:19:43.061420 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:19:43.061420 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:19:43.061420 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:19:43.061420 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:19:43.061420 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:19:43.062842 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:19:43.062842 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:19:43.062842 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:19:43.062842 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:19:43.062842 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:19:43.062842 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:19:43.062842 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:19:43.062842 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0652742c-8554-4c35-89cd-8ff0fb44659f could not be found. Sep 06 21:19:43.062842 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:19:43.062842 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:19:43.062842 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:19:43.062842 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:19:43.062842 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:19:43.062842 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:19:43.062842 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:19:43.062842 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:19:43.062842 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0652742c-8554-4c35-89cd-8ff0fb44659f could not be found. Sep 06 21:19:43.062842 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:19:43.064253 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1abd5f68-5493-49c6-a3c2-d35be5a3f7c1 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] Returning 404 to user: Instance 0652742c-8554-4c35-89cd-8ff0fb44659f could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:19:43.064253 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1abd5f68-5493-49c6-a3c2-d35be5a3f7c1 tempest-VolumesSnapshotTestJSON-1243964682 tempest-VolumesSnapshotTestJSON-1243964682-project] 10.222.0.79 "GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f" status: 404 len: 111 microversion: 2.1 time: 0.032038 Sep 06 21:19:43.064253 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 375/745] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:19:43 2022] GET /compute/v2.1/servers/0652742c-8554-4c35-89cd-8ff0fb44659f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:19:43.361703 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b57fbf60-d91c-44ca-8078-61015da78c3a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:43.362323 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b57fbf60-d91c-44ca-8078-61015da78c3a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:43.369065 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b57fbf60-d91c-44ca-8078-61015da78c3a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:43.369739 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b57fbf60-d91c-44ca-8078-61015da78c3a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:43.370251 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b57fbf60-d91c-44ca-8078-61015da78c3a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:43.370995 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b57fbf60-d91c-44ca-8078-61015da78c3a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:43.371620 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b57fbf60-d91c-44ca-8078-61015da78c3a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:43.372011 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b57fbf60-d91c-44ca-8078-61015da78c3a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:43.759772 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b57fbf60-d91c-44ca-8078-61015da78c3a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:43.772986 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b57fbf60-d91c-44ca-8078-61015da78c3a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:43.774622 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b57fbf60-d91c-44ca-8078-61015da78c3a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:43.776108 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b57fbf60-d91c-44ca-8078-61015da78c3a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.418293 Sep 06 21:19:43.777054 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 371/746] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:43 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:44.804229 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-633a6075-a77b-48ce-9135-aecc4d5d3cd3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:44.804922 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-633a6075-a77b-48ce-9135-aecc4d5d3cd3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:44.812642 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-633a6075-a77b-48ce-9135-aecc4d5d3cd3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:44.813211 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-633a6075-a77b-48ce-9135-aecc4d5d3cd3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:44.813691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-633a6075-a77b-48ce-9135-aecc4d5d3cd3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:44.814468 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-633a6075-a77b-48ce-9135-aecc4d5d3cd3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:44.814969 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-633a6075-a77b-48ce-9135-aecc4d5d3cd3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:44.815438 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-633a6075-a77b-48ce-9135-aecc4d5d3cd3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:44.949436 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-633a6075-a77b-48ce-9135-aecc4d5d3cd3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:44.958712 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-633a6075-a77b-48ce-9135-aecc4d5d3cd3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:44.960146 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-633a6075-a77b-48ce-9135-aecc4d5d3cd3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:44.961344 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-633a6075-a77b-48ce-9135-aecc4d5d3cd3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.161536 Sep 06 21:19:44.961888 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 376/747] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:44 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:45.987353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4a88e9ac-df6e-48a7-abd2-688f8631a1eb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:45.987906 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4a88e9ac-df6e-48a7-abd2-688f8631a1eb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:45.995173 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a88e9ac-df6e-48a7-abd2-688f8631a1eb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:45.995628 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a88e9ac-df6e-48a7-abd2-688f8631a1eb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:45.996077 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a88e9ac-df6e-48a7-abd2-688f8631a1eb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:45.996788 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a88e9ac-df6e-48a7-abd2-688f8631a1eb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:45.997226 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a88e9ac-df6e-48a7-abd2-688f8631a1eb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:45.997623 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a88e9ac-df6e-48a7-abd2-688f8631a1eb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:46.138240 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4a88e9ac-df6e-48a7-abd2-688f8631a1eb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:46.152286 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4a88e9ac-df6e-48a7-abd2-688f8631a1eb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:46.154347 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4a88e9ac-df6e-48a7-abd2-688f8631a1eb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:46.156119 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4a88e9ac-df6e-48a7-abd2-688f8631a1eb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.172642 Sep 06 21:19:46.156938 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 372/748] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:45 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:47.186592 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-14475ebf-97cc-4d22-8907-53f6ea3fe902 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:47.187639 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-14475ebf-97cc-4d22-8907-53f6ea3fe902 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:47.198541 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14475ebf-97cc-4d22-8907-53f6ea3fe902 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:47.199324 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14475ebf-97cc-4d22-8907-53f6ea3fe902 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:47.200031 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14475ebf-97cc-4d22-8907-53f6ea3fe902 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:47.201202 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14475ebf-97cc-4d22-8907-53f6ea3fe902 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:47.201942 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14475ebf-97cc-4d22-8907-53f6ea3fe902 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:47.202639 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14475ebf-97cc-4d22-8907-53f6ea3fe902 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:47.339879 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-14475ebf-97cc-4d22-8907-53f6ea3fe902 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:47.353369 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-14475ebf-97cc-4d22-8907-53f6ea3fe902 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:47.356132 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-14475ebf-97cc-4d22-8907-53f6ea3fe902 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:47.357970 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-14475ebf-97cc-4d22-8907-53f6ea3fe902 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.177671 Sep 06 21:19:47.358748 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 377/749] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:47 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:48.387950 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3cf1de9d-362d-492b-8013-9fd50eb39ea4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:48.389005 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3cf1de9d-362d-492b-8013-9fd50eb39ea4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:48.400157 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3cf1de9d-362d-492b-8013-9fd50eb39ea4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:48.401206 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3cf1de9d-362d-492b-8013-9fd50eb39ea4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:48.401769 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3cf1de9d-362d-492b-8013-9fd50eb39ea4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:48.402967 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3cf1de9d-362d-492b-8013-9fd50eb39ea4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:48.403717 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3cf1de9d-362d-492b-8013-9fd50eb39ea4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:48.404421 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3cf1de9d-362d-492b-8013-9fd50eb39ea4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:48.554754 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3cf1de9d-362d-492b-8013-9fd50eb39ea4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:48.563829 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3cf1de9d-362d-492b-8013-9fd50eb39ea4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:48.565338 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3cf1de9d-362d-492b-8013-9fd50eb39ea4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:48.566507 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3cf1de9d-362d-492b-8013-9fd50eb39ea4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.185142 Sep 06 21:19:48.567096 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 373/750] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:48 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:49.596621 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-54f243e4-f7bf-4111-a978-c049b30598d0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:49.597259 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-54f243e4-f7bf-4111-a978-c049b30598d0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:49.604450 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54f243e4-f7bf-4111-a978-c049b30598d0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:49.604958 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54f243e4-f7bf-4111-a978-c049b30598d0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:49.605387 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54f243e4-f7bf-4111-a978-c049b30598d0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:49.606080 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54f243e4-f7bf-4111-a978-c049b30598d0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:49.606521 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54f243e4-f7bf-4111-a978-c049b30598d0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:49.606937 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54f243e4-f7bf-4111-a978-c049b30598d0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:49.754948 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-54f243e4-f7bf-4111-a978-c049b30598d0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:49.764185 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-54f243e4-f7bf-4111-a978-c049b30598d0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:49.765655 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-54f243e4-f7bf-4111-a978-c049b30598d0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:49.766922 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-54f243e4-f7bf-4111-a978-c049b30598d0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.176990 Sep 06 21:19:49.767608 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 378/751] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:49 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:50.794638 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d42d0d84-e6ed-4e35-8965-be6f101c8192 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:50.795240 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d42d0d84-e6ed-4e35-8965-be6f101c8192 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:50.802626 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d42d0d84-e6ed-4e35-8965-be6f101c8192 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:50.803098 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d42d0d84-e6ed-4e35-8965-be6f101c8192 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:50.803530 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d42d0d84-e6ed-4e35-8965-be6f101c8192 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:50.804209 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d42d0d84-e6ed-4e35-8965-be6f101c8192 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:50.804648 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d42d0d84-e6ed-4e35-8965-be6f101c8192 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:50.805087 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d42d0d84-e6ed-4e35-8965-be6f101c8192 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:50.941267 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d42d0d84-e6ed-4e35-8965-be6f101c8192 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:50.944795 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:19:50.950881 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d42d0d84-e6ed-4e35-8965-be6f101c8192 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:50.952336 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d42d0d84-e6ed-4e35-8965-be6f101c8192 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:50.953519 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d42d0d84-e6ed-4e35-8965-be6f101c8192 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.163324 Sep 06 21:19:50.954111 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 374/752] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:50 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:51.981686 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d1dbcaac-9b4b-47ec-af09-b262e0e37db0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:51.982515 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d1dbcaac-9b4b-47ec-af09-b262e0e37db0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:51.991599 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1dbcaac-9b4b-47ec-af09-b262e0e37db0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:51.992234 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1dbcaac-9b4b-47ec-af09-b262e0e37db0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:51.992850 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1dbcaac-9b4b-47ec-af09-b262e0e37db0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:51.993802 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1dbcaac-9b4b-47ec-af09-b262e0e37db0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:51.994408 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1dbcaac-9b4b-47ec-af09-b262e0e37db0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:51.994968 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1dbcaac-9b4b-47ec-af09-b262e0e37db0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:52.134551 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d1dbcaac-9b4b-47ec-af09-b262e0e37db0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:52.146252 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d1dbcaac-9b4b-47ec-af09-b262e0e37db0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:52.148591 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d1dbcaac-9b4b-47ec-af09-b262e0e37db0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:52.150592 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d1dbcaac-9b4b-47ec-af09-b262e0e37db0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.174138 Sep 06 21:19:52.151448 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 379/753] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:51 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:53.180457 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0df6c1d5-f7de-4392-9846-9d734a3fdb13 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:53.181126 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0df6c1d5-f7de-4392-9846-9d734a3fdb13 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:53.188411 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0df6c1d5-f7de-4392-9846-9d734a3fdb13 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:53.188931 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0df6c1d5-f7de-4392-9846-9d734a3fdb13 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:53.189364 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0df6c1d5-f7de-4392-9846-9d734a3fdb13 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:53.190059 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0df6c1d5-f7de-4392-9846-9d734a3fdb13 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:53.190507 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0df6c1d5-f7de-4392-9846-9d734a3fdb13 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:53.190936 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0df6c1d5-f7de-4392-9846-9d734a3fdb13 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:53.325892 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0df6c1d5-f7de-4392-9846-9d734a3fdb13 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:53.337008 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0df6c1d5-f7de-4392-9846-9d734a3fdb13 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:53.338445 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0df6c1d5-f7de-4392-9846-9d734a3fdb13 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:53.339667 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0df6c1d5-f7de-4392-9846-9d734a3fdb13 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.163159 Sep 06 21:19:53.340236 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 375/754] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:53 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:54.367615 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7c446518-a6a8-424b-88f8-00c484d652e4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:54.368195 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7c446518-a6a8-424b-88f8-00c484d652e4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:54.376114 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c446518-a6a8-424b-88f8-00c484d652e4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:54.376607 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c446518-a6a8-424b-88f8-00c484d652e4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:54.377207 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c446518-a6a8-424b-88f8-00c484d652e4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:54.378024 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c446518-a6a8-424b-88f8-00c484d652e4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:54.378496 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c446518-a6a8-424b-88f8-00c484d652e4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:54.378887 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c446518-a6a8-424b-88f8-00c484d652e4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:54.523470 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7c446518-a6a8-424b-88f8-00c484d652e4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:54.533698 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7c446518-a6a8-424b-88f8-00c484d652e4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:54.535600 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7c446518-a6a8-424b-88f8-00c484d652e4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:54.537187 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7c446518-a6a8-424b-88f8-00c484d652e4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.173594 Sep 06 21:19:54.538052 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 380/755] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:54 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:55.564223 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-77eff266-216a-45f2-a0b8-68b463fde090 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:55.564859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-77eff266-216a-45f2-a0b8-68b463fde090 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:55.571774 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77eff266-216a-45f2-a0b8-68b463fde090 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:55.572253 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77eff266-216a-45f2-a0b8-68b463fde090 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:55.572686 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77eff266-216a-45f2-a0b8-68b463fde090 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:55.573426 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77eff266-216a-45f2-a0b8-68b463fde090 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:55.573868 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77eff266-216a-45f2-a0b8-68b463fde090 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:55.574282 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77eff266-216a-45f2-a0b8-68b463fde090 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:55.727908 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-77eff266-216a-45f2-a0b8-68b463fde090 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:55.736722 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-77eff266-216a-45f2-a0b8-68b463fde090 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:55.738191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-77eff266-216a-45f2-a0b8-68b463fde090 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:55.739368 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-77eff266-216a-45f2-a0b8-68b463fde090 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.180084 Sep 06 21:19:55.739918 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 376/756] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:55 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:56.769203 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-14ced660-1c89-4447-92f5-72ed8b3b7496 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:56.770060 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-14ced660-1c89-4447-92f5-72ed8b3b7496 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:56.778127 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14ced660-1c89-4447-92f5-72ed8b3b7496 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:56.778127 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14ced660-1c89-4447-92f5-72ed8b3b7496 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:56.778127 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14ced660-1c89-4447-92f5-72ed8b3b7496 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:56.778633 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14ced660-1c89-4447-92f5-72ed8b3b7496 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:56.779084 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14ced660-1c89-4447-92f5-72ed8b3b7496 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:56.779506 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-14ced660-1c89-4447-92f5-72ed8b3b7496 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:56.923100 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-14ced660-1c89-4447-92f5-72ed8b3b7496 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:56.933557 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-14ced660-1c89-4447-92f5-72ed8b3b7496 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:56.934967 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-14ced660-1c89-4447-92f5-72ed8b3b7496 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:56.936122 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-14ced660-1c89-4447-92f5-72ed8b3b7496 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.173644 Sep 06 21:19:56.936696 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 381/757] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:56 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:57.968189 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-625f6c05-81b5-4903-9def-14cfcac959af tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:57.968803 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-625f6c05-81b5-4903-9def-14cfcac959af tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:57.975485 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-625f6c05-81b5-4903-9def-14cfcac959af tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:57.975964 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-625f6c05-81b5-4903-9def-14cfcac959af tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:57.976392 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-625f6c05-81b5-4903-9def-14cfcac959af tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:57.977127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-625f6c05-81b5-4903-9def-14cfcac959af tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:57.977567 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-625f6c05-81b5-4903-9def-14cfcac959af tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:57.977990 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-625f6c05-81b5-4903-9def-14cfcac959af tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:58.115698 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-625f6c05-81b5-4903-9def-14cfcac959af tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:58.125325 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-625f6c05-81b5-4903-9def-14cfcac959af tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:58.126747 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-625f6c05-81b5-4903-9def-14cfcac959af tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:58.127903 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-625f6c05-81b5-4903-9def-14cfcac959af tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.163811 Sep 06 21:19:58.128454 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 377/758] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:57 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:59.155379 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-35b76e92-eec9-4557-943b-208c4f0cee97 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:19:59.155989 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-35b76e92-eec9-4557-943b-208c4f0cee97 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:19:59.158192 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=66 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:19:59.163866 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35b76e92-eec9-4557-943b-208c4f0cee97 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:59.164352 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35b76e92-eec9-4557-943b-208c4f0cee97 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:59.164818 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35b76e92-eec9-4557-943b-208c4f0cee97 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:59.165523 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35b76e92-eec9-4557-943b-208c4f0cee97 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:59.166071 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35b76e92-eec9-4557-943b-208c4f0cee97 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:59.166543 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35b76e92-eec9-4557-943b-208c4f0cee97 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:59.301549 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-35b76e92-eec9-4557-943b-208c4f0cee97 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:59.311144 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-35b76e92-eec9-4557-943b-208c4f0cee97 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:59.312671 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-35b76e92-eec9-4557-943b-208c4f0cee97 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:19:59.314690 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-35b76e92-eec9-4557-943b-208c4f0cee97 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.164311 Sep 06 21:19:59.315588 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 382/759] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:19:59 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:19:59.350233 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-31726061-afb6-4a86-9e27-9b13fbdf0145 req-d697fedf-150e-4e5e-81eb-71be9d27d62e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fea1aa0-032e-454d-9358-98a81cd5d650", "name": "network-vif-plugged", "status": "completed", "tag": "7ea4447f-6e97-421a-ae16-09790d6651e8"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:19:59.361604 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-31726061-afb6-4a86-9e27-9b13fbdf0145 req-d697fedf-150e-4e5e-81eb-71be9d27d62e service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:19:59.362035 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-31726061-afb6-4a86-9e27-9b13fbdf0145 req-d697fedf-150e-4e5e-81eb-71be9d27d62e service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:19:59.362586 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-31726061-afb6-4a86-9e27-9b13fbdf0145 req-d697fedf-150e-4e5e-81eb-71be9d27d62e service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:19:59.376453 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-31726061-afb6-4a86-9e27-9b13fbdf0145 req-d697fedf-150e-4e5e-81eb-71be9d27d62e service nova] Creating event network-vif-plugged:7ea4447f-6e97-421a-ae16-09790d6651e8 for instance 8fea1aa0-032e-454d-9358-98a81cd5d650 on hv-cinder-74915 Sep 06 21:19:59.382491 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-31726061-afb6-4a86-9e27-9b13fbdf0145 req-d697fedf-150e-4e5e-81eb-71be9d27d62e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036610 Sep 06 21:19:59.384241 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 378/760] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:20:00.341813 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-442f20c7-9eae-4789-bd57-4a9bab75fdb8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:00.342426 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-442f20c7-9eae-4789-bd57-4a9bab75fdb8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:00.349524 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-442f20c7-9eae-4789-bd57-4a9bab75fdb8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:00.350037 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-442f20c7-9eae-4789-bd57-4a9bab75fdb8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:00.350681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-442f20c7-9eae-4789-bd57-4a9bab75fdb8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:00.351380 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-442f20c7-9eae-4789-bd57-4a9bab75fdb8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:00.351870 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-442f20c7-9eae-4789-bd57-4a9bab75fdb8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:00.352297 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-442f20c7-9eae-4789-bd57-4a9bab75fdb8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:00.529405 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-442f20c7-9eae-4789-bd57-4a9bab75fdb8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:00.539012 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-442f20c7-9eae-4789-bd57-4a9bab75fdb8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:00.540867 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-442f20c7-9eae-4789-bd57-4a9bab75fdb8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:00.542530 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-442f20c7-9eae-4789-bd57-4a9bab75fdb8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.204880 Sep 06 21:20:00.543211 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 383/761] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:20:00 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:20:01.569730 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e57fa24f-6678-4fae-be28-324cdd2d4464 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:01.570467 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e57fa24f-6678-4fae-be28-324cdd2d4464 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:01.573004 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=38 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:20:01.589071 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e57fa24f-6678-4fae-be28-324cdd2d4464 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:01.589071 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e57fa24f-6678-4fae-be28-324cdd2d4464 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:01.589071 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e57fa24f-6678-4fae-be28-324cdd2d4464 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:01.589071 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e57fa24f-6678-4fae-be28-324cdd2d4464 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:01.589456 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e57fa24f-6678-4fae-be28-324cdd2d4464 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:01.589456 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e57fa24f-6678-4fae-be28-324cdd2d4464 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:01.718262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e57fa24f-6678-4fae-be28-324cdd2d4464 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:01.727640 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e57fa24f-6678-4fae-be28-324cdd2d4464 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:01.729529 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e57fa24f-6678-4fae-be28-324cdd2d4464 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:01.730568 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e57fa24f-6678-4fae-be28-324cdd2d4464 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.165253 Sep 06 21:20:01.731415 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 379/762] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:20:01 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:20:02.649480 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4c9ccc51-64d4-46c9-9fab-0d68c84fab33 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6342aa22-0c75-4882-af78-4c9347a51547"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:20:02.652041 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4c9ccc51-64d4-46c9-9fab-0d68c84fab33 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:02.658338 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c9ccc51-64d4-46c9-9fab-0d68c84fab33 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:02.658765 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c9ccc51-64d4-46c9-9fab-0d68c84fab33 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:02.659199 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c9ccc51-64d4-46c9-9fab-0d68c84fab33 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:02.659915 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c9ccc51-64d4-46c9-9fab-0d68c84fab33 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:02.660365 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c9ccc51-64d4-46c9-9fab-0d68c84fab33 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:02.660811 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c9ccc51-64d4-46c9-9fab-0d68c84fab33 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:02.758289 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8d276693-3a1a-478f-8ec3-05f407e4507b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:02.758918 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8d276693-3a1a-478f-8ec3-05f407e4507b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:02.765609 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d276693-3a1a-478f-8ec3-05f407e4507b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:02.766090 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d276693-3a1a-478f-8ec3-05f407e4507b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:02.766525 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d276693-3a1a-478f-8ec3-05f407e4507b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:02.767254 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d276693-3a1a-478f-8ec3-05f407e4507b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:02.767707 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d276693-3a1a-478f-8ec3-05f407e4507b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:02.768248 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d276693-3a1a-478f-8ec3-05f407e4507b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:02.920014 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8d276693-3a1a-478f-8ec3-05f407e4507b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:02.929260 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8d276693-3a1a-478f-8ec3-05f407e4507b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:02.930694 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8d276693-3a1a-478f-8ec3-05f407e4507b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:02.931862 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8d276693-3a1a-478f-8ec3-05f407e4507b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1808 microversion: 2.20 time: 0.178476 Sep 06 21:20:02.932503 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 380/763] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:20:02 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:20:03.370487 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:20:03.395414 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4c9ccc51-64d4-46c9-9fab-0d68c84fab33 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "POST /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.859846 Sep 06 21:20:03.396425 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 384/764] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Sep 6 21:20:02 2022] POST /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac/os-volume_attachments => generated 194 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:20:03.957073 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-947bb1cc-dfef-47ce-acc2-72e2263178e1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:03.957640 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-947bb1cc-dfef-47ce-acc2-72e2263178e1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:03.965623 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-947bb1cc-dfef-47ce-acc2-72e2263178e1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:03.966423 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-947bb1cc-dfef-47ce-acc2-72e2263178e1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:03.967030 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-947bb1cc-dfef-47ce-acc2-72e2263178e1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:03.967907 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-947bb1cc-dfef-47ce-acc2-72e2263178e1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:03.968527 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-947bb1cc-dfef-47ce-acc2-72e2263178e1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:03.969183 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-947bb1cc-dfef-47ce-acc2-72e2263178e1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:04.106608 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-947bb1cc-dfef-47ce-acc2-72e2263178e1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:04.115993 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-947bb1cc-dfef-47ce-acc2-72e2263178e1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:04.117434 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-947bb1cc-dfef-47ce-acc2-72e2263178e1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:04.118583 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-947bb1cc-dfef-47ce-acc2-72e2263178e1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1795 microversion: 2.20 time: 0.165412 Sep 06 21:20:04.119137 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 381/765] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:20:03 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1795 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:20:12.058979 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-be1f8598-8f6a-4814-9c18-1d8112495dba tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:20:12.061415 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-be1f8598-8f6a-4814-9c18-1d8112495dba tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:12.068159 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be1f8598-8f6a-4814-9c18-1d8112495dba tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:12.068650 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be1f8598-8f6a-4814-9c18-1d8112495dba tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:12.069112 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be1f8598-8f6a-4814-9c18-1d8112495dba tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:12.069829 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be1f8598-8f6a-4814-9c18-1d8112495dba tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:12.070282 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be1f8598-8f6a-4814-9c18-1d8112495dba tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:12.070688 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be1f8598-8f6a-4814-9c18-1d8112495dba tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:12.095257 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-be1f8598-8f6a-4814-9c18-1d8112495dba tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lazy-loading 'flavor' on Instance uuid 62f05cca-d038-4795-a189-bc7aa10064ac {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:20:12.240116 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-be1f8598-8f6a-4814-9c18-1d8112495dba tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "POST /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac/action" status: 200 len: 32 microversion: 2.1 time: 0.186103 Sep 06 21:20:12.240641 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 385/766] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Sep 6 21:20:12 2022] POST /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac/action => generated 32 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 21:20:12.250303 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-37da093a-5fbb-4f26-8fb7-0e67b55a50d3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:12.250902 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-37da093a-5fbb-4f26-8fb7-0e67b55a50d3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:12.258351 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-37da093a-5fbb-4f26-8fb7-0e67b55a50d3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:12.258898 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-37da093a-5fbb-4f26-8fb7-0e67b55a50d3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:12.259460 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-37da093a-5fbb-4f26-8fb7-0e67b55a50d3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:12.260349 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-37da093a-5fbb-4f26-8fb7-0e67b55a50d3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:12.261210 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-37da093a-5fbb-4f26-8fb7-0e67b55a50d3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:12.261652 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-37da093a-5fbb-4f26-8fb7-0e67b55a50d3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:12.496074 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-37da093a-5fbb-4f26-8fb7-0e67b55a50d3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:12.505177 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-37da093a-5fbb-4f26-8fb7-0e67b55a50d3 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1734 microversion: 2.1 time: 0.258607 Sep 06 21:20:12.505751 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 382/767] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:20:12 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1734 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:20:13.534717 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7e01d17b-4ddb-4fde-8285-dfe3f5999afc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:13.535857 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7e01d17b-4ddb-4fde-8285-dfe3f5999afc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:13.544913 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e01d17b-4ddb-4fde-8285-dfe3f5999afc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:13.545460 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e01d17b-4ddb-4fde-8285-dfe3f5999afc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:13.545918 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e01d17b-4ddb-4fde-8285-dfe3f5999afc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:13.546624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e01d17b-4ddb-4fde-8285-dfe3f5999afc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:13.547086 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e01d17b-4ddb-4fde-8285-dfe3f5999afc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:13.547516 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e01d17b-4ddb-4fde-8285-dfe3f5999afc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:13.693755 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7e01d17b-4ddb-4fde-8285-dfe3f5999afc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:13.703997 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7e01d17b-4ddb-4fde-8285-dfe3f5999afc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1734 microversion: 2.1 time: 0.177517 Sep 06 21:20:13.704577 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 386/768] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:20:13 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:20:14.737377 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3a05b125-e4ca-4307-88f8-f2f7a689c424 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:14.738351 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3a05b125-e4ca-4307-88f8-f2f7a689c424 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:14.746693 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a05b125-e4ca-4307-88f8-f2f7a689c424 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:14.747177 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a05b125-e4ca-4307-88f8-f2f7a689c424 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:14.747599 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a05b125-e4ca-4307-88f8-f2f7a689c424 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:14.748333 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a05b125-e4ca-4307-88f8-f2f7a689c424 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:14.748901 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a05b125-e4ca-4307-88f8-f2f7a689c424 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:14.752261 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a05b125-e4ca-4307-88f8-f2f7a689c424 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:14.895663 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3a05b125-e4ca-4307-88f8-f2f7a689c424 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:14.904402 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3a05b125-e4ca-4307-88f8-f2f7a689c424 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1734 microversion: 2.1 time: 0.172351 Sep 06 21:20:14.904999 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 383/769] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:20:14 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:20:15.935658 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3d43bb69-9153-41f3-9980-6a892eb7648d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:15.936322 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3d43bb69-9153-41f3-9980-6a892eb7648d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:15.946186 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d43bb69-9153-41f3-9980-6a892eb7648d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:15.946888 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d43bb69-9153-41f3-9980-6a892eb7648d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:15.947491 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d43bb69-9153-41f3-9980-6a892eb7648d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:15.948605 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d43bb69-9153-41f3-9980-6a892eb7648d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:15.949302 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d43bb69-9153-41f3-9980-6a892eb7648d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:15.949718 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d43bb69-9153-41f3-9980-6a892eb7648d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:16.098556 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3d43bb69-9153-41f3-9980-6a892eb7648d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:16.112341 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3d43bb69-9153-41f3-9980-6a892eb7648d tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1734 microversion: 2.1 time: 0.181648 Sep 06 21:20:16.113254 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 387/770] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:20:15 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1734 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:20:17.141466 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c0cdad38-53b2-4301-af4c-baa770652e21 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:17.142055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c0cdad38-53b2-4301-af4c-baa770652e21 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:17.149332 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0cdad38-53b2-4301-af4c-baa770652e21 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:17.149791 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0cdad38-53b2-4301-af4c-baa770652e21 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:17.150244 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0cdad38-53b2-4301-af4c-baa770652e21 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:17.150962 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0cdad38-53b2-4301-af4c-baa770652e21 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:17.151403 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0cdad38-53b2-4301-af4c-baa770652e21 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:17.151813 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0cdad38-53b2-4301-af4c-baa770652e21 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:17.302373 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c0cdad38-53b2-4301-af4c-baa770652e21 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:17.315741 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c0cdad38-53b2-4301-af4c-baa770652e21 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1734 microversion: 2.1 time: 0.178679 Sep 06 21:20:17.316624 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 384/771] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:20:17 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:20:18.343903 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e6784170-4852-46ed-a0a9-95a0d3c1aede tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:18.344682 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e6784170-4852-46ed-a0a9-95a0d3c1aede tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:18.353125 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6784170-4852-46ed-a0a9-95a0d3c1aede tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:18.353703 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6784170-4852-46ed-a0a9-95a0d3c1aede tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:18.354285 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6784170-4852-46ed-a0a9-95a0d3c1aede tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:18.355155 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6784170-4852-46ed-a0a9-95a0d3c1aede tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:18.355721 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6784170-4852-46ed-a0a9-95a0d3c1aede tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:18.356239 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6784170-4852-46ed-a0a9-95a0d3c1aede tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:18.501640 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e6784170-4852-46ed-a0a9-95a0d3c1aede tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:18.514212 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e6784170-4852-46ed-a0a9-95a0d3c1aede tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1734 microversion: 2.1 time: 0.175824 Sep 06 21:20:18.514950 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 388/772] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:20:18 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:20:19.548321 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4285dda3-451e-448f-bb74-4a483799a601 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:19.548927 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4285dda3-451e-448f-bb74-4a483799a601 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:19.555747 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4285dda3-451e-448f-bb74-4a483799a601 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:19.556223 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4285dda3-451e-448f-bb74-4a483799a601 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:19.556647 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4285dda3-451e-448f-bb74-4a483799a601 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:19.557408 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4285dda3-451e-448f-bb74-4a483799a601 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:19.557871 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4285dda3-451e-448f-bb74-4a483799a601 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:19.558279 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4285dda3-451e-448f-bb74-4a483799a601 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:19.693983 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4285dda3-451e-448f-bb74-4a483799a601 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:19.702901 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4285dda3-451e-448f-bb74-4a483799a601 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1734 microversion: 2.1 time: 0.160484 Sep 06 21:20:19.703486 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 385/773] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:20:19 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:20:20.729504 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5ae82447-d2e1-46ce-a14f-a9e7fe716f25 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:20.730494 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5ae82447-d2e1-46ce-a14f-a9e7fe716f25 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:20.740647 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ae82447-d2e1-46ce-a14f-a9e7fe716f25 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:20.741338 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ae82447-d2e1-46ce-a14f-a9e7fe716f25 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:20.741994 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ae82447-d2e1-46ce-a14f-a9e7fe716f25 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:20.742987 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ae82447-d2e1-46ce-a14f-a9e7fe716f25 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:20.743633 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ae82447-d2e1-46ce-a14f-a9e7fe716f25 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:20.744240 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ae82447-d2e1-46ce-a14f-a9e7fe716f25 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:20.883077 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5ae82447-d2e1-46ce-a14f-a9e7fe716f25 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:20.891811 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5ae82447-d2e1-46ce-a14f-a9e7fe716f25 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1734 microversion: 2.1 time: 0.168080 Sep 06 21:20:20.892381 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 389/774] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:20:20 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:20:21.919989 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cf1f2a3b-1b55-4385-b61f-4025f2036326 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:21.920959 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cf1f2a3b-1b55-4385-b61f-4025f2036326 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:21.930381 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf1f2a3b-1b55-4385-b61f-4025f2036326 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:21.930965 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf1f2a3b-1b55-4385-b61f-4025f2036326 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:21.931562 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf1f2a3b-1b55-4385-b61f-4025f2036326 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:21.932603 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf1f2a3b-1b55-4385-b61f-4025f2036326 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:21.933258 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf1f2a3b-1b55-4385-b61f-4025f2036326 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:21.933735 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf1f2a3b-1b55-4385-b61f-4025f2036326 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:22.084511 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cf1f2a3b-1b55-4385-b61f-4025f2036326 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:22.093367 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cf1f2a3b-1b55-4385-b61f-4025f2036326 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1734 microversion: 2.1 time: 0.180084 Sep 06 21:20:22.093940 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 386/775] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:20:21 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1734 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:20:23.117387 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a5d0d67b-6890-4267-ac00-f95ac20ee626 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:23.117944 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a5d0d67b-6890-4267-ac00-f95ac20ee626 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:23.125212 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5d0d67b-6890-4267-ac00-f95ac20ee626 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:23.125691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5d0d67b-6890-4267-ac00-f95ac20ee626 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:23.126122 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5d0d67b-6890-4267-ac00-f95ac20ee626 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:23.126810 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5d0d67b-6890-4267-ac00-f95ac20ee626 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:23.127260 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5d0d67b-6890-4267-ac00-f95ac20ee626 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:23.127678 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5d0d67b-6890-4267-ac00-f95ac20ee626 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:23.264794 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a5d0d67b-6890-4267-ac00-f95ac20ee626 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:23.273755 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a5d0d67b-6890-4267-ac00-f95ac20ee626 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1734 microversion: 2.1 time: 0.160262 Sep 06 21:20:23.274390 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 390/776] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:20:23 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:20:24.302223 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-050f5ea3-d9be-44bb-8ad4-a0dee18e74cb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:24.303196 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-050f5ea3-d9be-44bb-8ad4-a0dee18e74cb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:24.313410 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-050f5ea3-d9be-44bb-8ad4-a0dee18e74cb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:24.313875 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-050f5ea3-d9be-44bb-8ad4-a0dee18e74cb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:24.314315 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-050f5ea3-d9be-44bb-8ad4-a0dee18e74cb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:24.315037 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-050f5ea3-d9be-44bb-8ad4-a0dee18e74cb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:24.315482 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-050f5ea3-d9be-44bb-8ad4-a0dee18e74cb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:24.315896 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-050f5ea3-d9be-44bb-8ad4-a0dee18e74cb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:24.318524 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=69 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:20:24.456219 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-050f5ea3-d9be-44bb-8ad4-a0dee18e74cb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:24.469345 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-050f5ea3-d9be-44bb-8ad4-a0dee18e74cb tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1734 microversion: 2.1 time: 0.174951 Sep 06 21:20:24.469914 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 387/777] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:20:24 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:20:25.492934 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8f17bdab-132b-4f6e-aa97-3d3fef19b0ab tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:25.493570 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8f17bdab-132b-4f6e-aa97-3d3fef19b0ab tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:25.501424 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f17bdab-132b-4f6e-aa97-3d3fef19b0ab tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:25.501909 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f17bdab-132b-4f6e-aa97-3d3fef19b0ab tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:25.502341 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f17bdab-132b-4f6e-aa97-3d3fef19b0ab tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:25.503045 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f17bdab-132b-4f6e-aa97-3d3fef19b0ab tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:25.503497 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f17bdab-132b-4f6e-aa97-3d3fef19b0ab tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:25.503917 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f17bdab-132b-4f6e-aa97-3d3fef19b0ab tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:25.646946 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8f17bdab-132b-4f6e-aa97-3d3fef19b0ab tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:25.657904 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8f17bdab-132b-4f6e-aa97-3d3fef19b0ab tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1734 microversion: 2.1 time: 0.167477 Sep 06 21:20:25.658527 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 391/778] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:20:25 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:20:26.685643 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-69f018a1-fbd7-4588-93e0-6dc0c5e4430b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:26.686403 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-69f018a1-fbd7-4588-93e0-6dc0c5e4430b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:26.697426 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69f018a1-fbd7-4588-93e0-6dc0c5e4430b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:26.698015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69f018a1-fbd7-4588-93e0-6dc0c5e4430b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:26.698707 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69f018a1-fbd7-4588-93e0-6dc0c5e4430b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:26.699799 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69f018a1-fbd7-4588-93e0-6dc0c5e4430b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:26.700455 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69f018a1-fbd7-4588-93e0-6dc0c5e4430b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:26.701113 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69f018a1-fbd7-4588-93e0-6dc0c5e4430b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:26.850656 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-69f018a1-fbd7-4588-93e0-6dc0c5e4430b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:26.862980 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-69f018a1-fbd7-4588-93e0-6dc0c5e4430b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1734 microversion: 2.1 time: 0.183457 Sep 06 21:20:26.863803 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 388/779] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:20:26 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1734 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:20:27.891554 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d1b3f9b6-3c46-42f7-9917-c1b414874c4f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:27.892118 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d1b3f9b6-3c46-42f7-9917-c1b414874c4f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:27.899817 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1b3f9b6-3c46-42f7-9917-c1b414874c4f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:27.900468 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1b3f9b6-3c46-42f7-9917-c1b414874c4f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:27.900941 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1b3f9b6-3c46-42f7-9917-c1b414874c4f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:27.901775 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1b3f9b6-3c46-42f7-9917-c1b414874c4f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:27.902617 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1b3f9b6-3c46-42f7-9917-c1b414874c4f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:27.903059 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d1b3f9b6-3c46-42f7-9917-c1b414874c4f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:28.045192 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d1b3f9b6-3c46-42f7-9917-c1b414874c4f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:28.054105 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d1b3f9b6-3c46-42f7-9917-c1b414874c4f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1714 microversion: 2.1 time: 0.166669 Sep 06 21:20:28.054670 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 392/780] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:20:27 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1714 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:20:28.176382 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1fc3e27c-b541-43de-b5ce-42c14af05904 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:28.176977 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1fc3e27c-b541-43de-b5ce-42c14af05904 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:28.183300 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1fc3e27c-b541-43de-b5ce-42c14af05904 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:28.183777 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1fc3e27c-b541-43de-b5ce-42c14af05904 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:28.184200 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1fc3e27c-b541-43de-b5ce-42c14af05904 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:28.184937 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1fc3e27c-b541-43de-b5ce-42c14af05904 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:28.185381 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1fc3e27c-b541-43de-b5ce-42c14af05904 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:28.185796 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1fc3e27c-b541-43de-b5ce-42c14af05904 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:28.277504 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-1fc3e27c-b541-43de-b5ce-42c14af05904 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] HTTP exception thrown: Cannot 'detach_volume' instance 62f05cca-d038-4795-a189-bc7aa10064ac while it is in vm_state rescued Sep 06 21:20:28.279127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1fc3e27c-b541-43de-b5ce-42c14af05904 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Request method failure captured: Sep 06 21:20:28.279127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac/os-volume_attachments/6342aa22-0c75-4882-af78-4c9347a51547 HTTP/1.1 Sep 06 21:20:28.279127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 06 21:20:28.279127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 06 21:20:28.279127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Connection: close Sep 06 21:20:28.279127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 06 21:20:28.279127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 06 21:20:28.279127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Host: 10.222.0.79 Sep 06 21:20:28.279127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 06 21:20:28.279127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 06 21:20:28.279127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjF7gUN_FLSnpNG9HSuch7Adumi07PvDapiWYlb4hdEBJJ-3oDVKZT8eH0XUiQphynu_EAk0GMMbuGt07jVLp2XHuc-gGocBp-HoFX8pN_ZBw-uxiJnYglnmqkenrCvYYKoQN5M4O4ySALb1G6TjikmxU7GQJcI9jL4bBNWv5FzOObxk8 Sep 06 21:20:28.279127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 06 21:20:28.279127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 06 21:20:28.279127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 06 21:20:28.279127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 06 21:20:28.279127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 06 21:20:28.279127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 06 21:20:28.279127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Id: ff397d6b3f4a42bf8b68b3bc55600dba Sep 06 21:20:28.279127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-456052109 Sep 06 21:20:28.279127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Role: reader,member Sep 06 21:20:28.279127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Sep 06 21:20:28.280691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ff397d6b3f4a42bf8b68b3bc55600dba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ff397d6b3f4a42bf8b68b3bc55600dba", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ff397d6b3f4a42bf8b68b3bc55600dba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ff397d6b3f4a42bf8b68b3bc55600dba"}]}] Sep 06 21:20:28.280691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-ServerRescueNegativeTestJSON-456052109 Sep 06 21:20:28.280691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Id: ff397d6b3f4a42bf8b68b3bc55600dba Sep 06 21:20:28.280691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-456052109 Sep 06 21:20:28.280691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User: tempest-ServerRescueNegativeTestJSON-456052109-project Sep 06 21:20:28.280691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 06 21:20:28.280691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 06 21:20:28.280691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Id: 2ec47d6e2e9b40a6bd207c084041f7a9 Sep 06 21:20:28.280691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-ServerRescueNegativeTestJSON-456052109-project Sep 06 21:20:28.280691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: method: > Sep 06 21:20:28.280691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: exception: Cannot 'detach_volume' instance 62f05cca-d038-4795-a189-bc7aa10064ac while it is in vm_state rescued Sep 06 21:20:28.282676 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: action_args: {'server_id': '62f05cca-d038-4795-a189-bc7aa10064ac', 'id': '6342aa22-0c75-4882-af78-4c9347a51547'} Sep 06 21:20:28.282676 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:20:28.282676 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:20:28.282676 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 06 21:20:28.282676 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 06 21:20:28.282676 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 21:20:28.282676 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 21:20:28.282676 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 06 21:20:28.282676 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 21:20:28.282676 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 62f05cca-d038-4795-a189-bc7aa10064ac in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 06 21:20:28.282676 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:20:28.282676 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:20:28.282676 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:20:28.282676 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:20:28.282676 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:20:28.282676 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:20:28.282676 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:20:28.282676 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:20:28.282676 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:20:28.282676 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:20:28.284182 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 06 21:20:28.284182 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 06 21:20:28.284182 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 21:20:28.284182 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 21:20:28.284182 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 62f05cca-d038-4795-a189-bc7aa10064ac while it is in vm_state rescued Sep 06 21:20:28.284182 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:20:28.284182 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:20:28.284182 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:20:28.284182 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:20:28.284182 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:20:28.284182 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:20:28.284182 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:20:28.284182 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:20:28.284182 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 62f05cca-d038-4795-a189-bc7aa10064ac while it is in vm_state rescued Sep 06 21:20:28.284182 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:20:28.284182 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1fc3e27c-b541-43de-b5ce-42c14af05904 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Returning 409 to user: Cannot 'detach_volume' instance 62f05cca-d038-4795-a189-bc7aa10064ac while it is in vm_state rescued {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:20:28.285346 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1fc3e27c-b541-43de-b5ce-42c14af05904 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "DELETE /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac/os-volume_attachments/6342aa22-0c75-4882-af78-4c9347a51547" status: 409 len: 152 microversion: 2.1 time: 0.108608 Sep 06 21:20:28.285346 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 389/781] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Sep 6 21:20:28 2022] DELETE /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac/os-volume_attachments/6342aa22-0c75-4882-af78-4c9347a51547 => generated 152 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 06 21:20:28.292368 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b7d03699-ae55-4dc5-b252-e8d8d9ec565f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:20:28.293069 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b7d03699-ae55-4dc5-b252-e8d8d9ec565f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:28.301038 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7d03699-ae55-4dc5-b252-e8d8d9ec565f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:28.301532 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7d03699-ae55-4dc5-b252-e8d8d9ec565f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:28.301963 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7d03699-ae55-4dc5-b252-e8d8d9ec565f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:28.302653 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7d03699-ae55-4dc5-b252-e8d8d9ec565f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:28.303099 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7d03699-ae55-4dc5-b252-e8d8d9ec565f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:28.303517 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7d03699-ae55-4dc5-b252-e8d8d9ec565f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:28.374272 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b7d03699-ae55-4dc5-b252-e8d8d9ec565f tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "POST /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac/action" status: 202 len: 0 microversion: 2.1 time: 0.087886 Sep 06 21:20:28.375594 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 393/782] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Sep 6 21:20:28 2022] POST /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:20:28.384573 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-219bc801-eb60-48c3-8da2-1e29252445d8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:28.385272 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-219bc801-eb60-48c3-8da2-1e29252445d8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:28.391908 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-219bc801-eb60-48c3-8da2-1e29252445d8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:28.392465 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-219bc801-eb60-48c3-8da2-1e29252445d8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:28.393079 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-219bc801-eb60-48c3-8da2-1e29252445d8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:28.393755 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-219bc801-eb60-48c3-8da2-1e29252445d8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:28.394195 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-219bc801-eb60-48c3-8da2-1e29252445d8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:28.394613 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-219bc801-eb60-48c3-8da2-1e29252445d8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:28.618215 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-219bc801-eb60-48c3-8da2-1e29252445d8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:28.627210 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-219bc801-eb60-48c3-8da2-1e29252445d8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1722 microversion: 2.1 time: 0.246473 Sep 06 21:20:28.627792 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 390/783] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:20:28 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:20:29.653411 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a6e8f5a9-d4c5-44cf-92d6-6caf32c758c5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:29.654338 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a6e8f5a9-d4c5-44cf-92d6-6caf32c758c5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:29.657476 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=24 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:20:29.664711 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6e8f5a9-d4c5-44cf-92d6-6caf32c758c5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:29.665307 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6e8f5a9-d4c5-44cf-92d6-6caf32c758c5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:29.665898 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6e8f5a9-d4c5-44cf-92d6-6caf32c758c5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:29.666812 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6e8f5a9-d4c5-44cf-92d6-6caf32c758c5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:29.667370 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6e8f5a9-d4c5-44cf-92d6-6caf32c758c5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:29.667948 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6e8f5a9-d4c5-44cf-92d6-6caf32c758c5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:29.808721 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a6e8f5a9-d4c5-44cf-92d6-6caf32c758c5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:29.818455 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a6e8f5a9-d4c5-44cf-92d6-6caf32c758c5 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1722 microversion: 2.1 time: 0.170773 Sep 06 21:20:29.818996 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 394/784] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:20:29 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:20:30.845388 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4dd6be0c-7ef1-4823-802f-66782ac52116 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:30.846383 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4dd6be0c-7ef1-4823-802f-66782ac52116 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:30.850701 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 21:20:30.850970 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Tue Sep 6 21:20:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac (ip 10.222.0.79) !!! Sep 06 21:20:30.864965 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dd6be0c-7ef1-4823-802f-66782ac52116 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:30.865446 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dd6be0c-7ef1-4823-802f-66782ac52116 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:30.865886 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dd6be0c-7ef1-4823-802f-66782ac52116 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:30.866617 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dd6be0c-7ef1-4823-802f-66782ac52116 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:30.867069 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dd6be0c-7ef1-4823-802f-66782ac52116 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:30.867489 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4dd6be0c-7ef1-4823-802f-66782ac52116 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:31.010884 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4dd6be0c-7ef1-4823-802f-66782ac52116 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:31.019649 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4dd6be0c-7ef1-4823-802f-66782ac52116 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1722 microversion: 2.1 time: 0.181180 Sep 06 21:20:31.020225 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 391/785] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:20:30 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:20:32.043652 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-93060ac1-a118-41a9-884a-686c3ada62e8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:32.044299 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-93060ac1-a118-41a9-884a-686c3ada62e8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:32.052051 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93060ac1-a118-41a9-884a-686c3ada62e8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:32.052513 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93060ac1-a118-41a9-884a-686c3ada62e8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:32.053096 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93060ac1-a118-41a9-884a-686c3ada62e8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:32.053818 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93060ac1-a118-41a9-884a-686c3ada62e8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:32.054263 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93060ac1-a118-41a9-884a-686c3ada62e8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:32.054695 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93060ac1-a118-41a9-884a-686c3ada62e8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:32.191669 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-93060ac1-a118-41a9-884a-686c3ada62e8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:32.200695 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-93060ac1-a118-41a9-884a-686c3ada62e8 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1728 microversion: 2.1 time: 0.161123 Sep 06 21:20:32.201274 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 395/786] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:20:32 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:20:32.224144 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6d771704-3614-4dfd-ac62-ccad21115ee7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:32.224758 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6d771704-3614-4dfd-ac62-ccad21115ee7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:32.227004 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=26 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:20:32.232420 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d771704-3614-4dfd-ac62-ccad21115ee7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:32.232931 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d771704-3614-4dfd-ac62-ccad21115ee7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:32.233366 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d771704-3614-4dfd-ac62-ccad21115ee7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:32.234054 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d771704-3614-4dfd-ac62-ccad21115ee7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:32.234503 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d771704-3614-4dfd-ac62-ccad21115ee7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:32.234919 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d771704-3614-4dfd-ac62-ccad21115ee7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:32.334995 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6d771704-3614-4dfd-ac62-ccad21115ee7 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.114095 Sep 06 21:20:32.335872 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 392/787] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Sep 6 21:20:32 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:20:33.546333 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-55116cbd-580e-41b5-b691-f61fbed0714a req-5d888e3d-8950-4a1f-948c-d5caaf6431fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62f05cca-d038-4795-a189-bc7aa10064ac", "tag": "6ae70e6c-1486-49e9-ba26-6e0a2ae18f0e"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:20:33.558631 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-55116cbd-580e-41b5-b691-f61fbed0714a req-5d888e3d-8950-4a1f-948c-d5caaf6431fb service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:33.559098 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-55116cbd-580e-41b5-b691-f61fbed0714a req-5d888e3d-8950-4a1f-948c-d5caaf6431fb service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:33.559515 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-55116cbd-580e-41b5-b691-f61fbed0714a req-5d888e3d-8950-4a1f-948c-d5caaf6431fb service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:33.564433 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:20:33.577457 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-55116cbd-580e-41b5-b691-f61fbed0714a req-5d888e3d-8950-4a1f-948c-d5caaf6431fb service nova] Creating event network-changed:6ae70e6c-1486-49e9-ba26-6e0a2ae18f0e for instance 62f05cca-d038-4795-a189-bc7aa10064ac on hv-cinder-74915 Sep 06 21:20:33.583135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-55116cbd-580e-41b5-b691-f61fbed0714a req-5d888e3d-8950-4a1f-948c-d5caaf6431fb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040740 Sep 06 21:20:33.583972 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 396/788] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:20:35.602208 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-64977ca9-529b-48b2-81a3-c190c3091cb5 req-94151b7b-9d39-4533-baed-ad23d9a97756 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62f05cca-d038-4795-a189-bc7aa10064ac", "tag": "6ae70e6c-1486-49e9-ba26-6e0a2ae18f0e"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:20:35.612289 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-64977ca9-529b-48b2-81a3-c190c3091cb5 req-94151b7b-9d39-4533-baed-ad23d9a97756 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:35.612792 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-64977ca9-529b-48b2-81a3-c190c3091cb5 req-94151b7b-9d39-4533-baed-ad23d9a97756 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:35.613230 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-64977ca9-529b-48b2-81a3-c190c3091cb5 req-94151b7b-9d39-4533-baed-ad23d9a97756 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:35.625048 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-64977ca9-529b-48b2-81a3-c190c3091cb5 req-94151b7b-9d39-4533-baed-ad23d9a97756 service nova] Creating event network-changed:6ae70e6c-1486-49e9-ba26-6e0a2ae18f0e for instance 62f05cca-d038-4795-a189-bc7aa10064ac on hv-cinder-74915 Sep 06 21:20:35.630571 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-64977ca9-529b-48b2-81a3-c190c3091cb5 req-94151b7b-9d39-4533-baed-ad23d9a97756 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033586 Sep 06 21:20:35.631165 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 393/789] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:20:48.108914 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7f291d59-98fd-4dcf-8bd0-97be35c6e34f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:48.109636 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7f291d59-98fd-4dcf-8bd0-97be35c6e34f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:48.113006 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=5 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:20:48.120195 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f291d59-98fd-4dcf-8bd0-97be35c6e34f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:48.120867 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f291d59-98fd-4dcf-8bd0-97be35c6e34f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:48.121316 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f291d59-98fd-4dcf-8bd0-97be35c6e34f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:48.122084 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f291d59-98fd-4dcf-8bd0-97be35c6e34f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:48.122554 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f291d59-98fd-4dcf-8bd0-97be35c6e34f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:48.123004 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f291d59-98fd-4dcf-8bd0-97be35c6e34f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:48.256005 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-7f291d59-98fd-4dcf-8bd0-97be35c6e34f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lazy-loading 'services' on Instance uuid 9c787b30-603f-4b67-b10c-519b49f5e43f {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:20:48.381313 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7f291d59-98fd-4dcf-8bd0-97be35c6e34f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f/os-volume_attachments/756f783c-b492-45ea-8572-963bb9896c1a" status: 202 len: 0 microversion: 2.1 time: 0.278499 Sep 06 21:20:48.381901 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 397/790] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Sep 6 21:20:48 2022] DELETE /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f/os-volume_attachments/756f783c-b492-45ea-8572-963bb9896c1a => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:20:49.511430 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:20:49.512156 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=35 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:20:49.516401 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-423dc315-6060-44fc-81a3-b0ac9d412433 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:20:49.523717 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-423dc315-6060-44fc-81a3-b0ac9d412433 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:49.524198 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-423dc315-6060-44fc-81a3-b0ac9d412433 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:49.524627 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-423dc315-6060-44fc-81a3-b0ac9d412433 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:49.548777 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-423dc315-6060-44fc-81a3-b0ac9d412433 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Going to try to stop instance {{(pid=120720) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 06 21:20:49.594424 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-423dc315-6060-44fc-81a3-b0ac9d412433 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "POST /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f/action" status: 202 len: 0 microversion: 2.1 time: 0.084836 Sep 06 21:20:49.595036 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 394/791] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Sep 6 21:20:49 2022] POST /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:20:49.604484 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6fc8c633-5b38-4da4-981c-6d9d23eb9137 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:49.605198 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6fc8c633-5b38-4da4-981c-6d9d23eb9137 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:49.611528 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6fc8c633-5b38-4da4-981c-6d9d23eb9137 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:49.612048 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6fc8c633-5b38-4da4-981c-6d9d23eb9137 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:49.612466 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6fc8c633-5b38-4da4-981c-6d9d23eb9137 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:49.613300 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6fc8c633-5b38-4da4-981c-6d9d23eb9137 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:49.613716 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6fc8c633-5b38-4da4-981c-6d9d23eb9137 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:49.614157 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6fc8c633-5b38-4da4-981c-6d9d23eb9137 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:49.753862 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6fc8c633-5b38-4da4-981c-6d9d23eb9137 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:49.763364 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6fc8c633-5b38-4da4-981c-6d9d23eb9137 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1676 microversion: 2.1 time: 0.163660 Sep 06 21:20:49.763928 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 398/792] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:20:49 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:20:50.788380 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-577ac948-781b-43de-af68-cb81bdea3a2f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:50.789107 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-577ac948-781b-43de-af68-cb81bdea3a2f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:50.795859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-577ac948-781b-43de-af68-cb81bdea3a2f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:50.796335 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-577ac948-781b-43de-af68-cb81bdea3a2f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:50.796800 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-577ac948-781b-43de-af68-cb81bdea3a2f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:50.797499 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-577ac948-781b-43de-af68-cb81bdea3a2f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:50.798306 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-577ac948-781b-43de-af68-cb81bdea3a2f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:50.798706 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-577ac948-781b-43de-af68-cb81bdea3a2f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:50.937430 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-577ac948-781b-43de-af68-cb81bdea3a2f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:50.949596 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-577ac948-781b-43de-af68-cb81bdea3a2f tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1676 microversion: 2.1 time: 0.165554 Sep 06 21:20:50.950366 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 395/793] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:20:50 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:20:51.980761 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cf12983b-f065-48c1-98d1-9f8c83b31624 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:51.981331 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cf12983b-f065-48c1-98d1-9f8c83b31624 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:51.987992 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf12983b-f065-48c1-98d1-9f8c83b31624 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:51.988478 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf12983b-f065-48c1-98d1-9f8c83b31624 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:51.988939 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf12983b-f065-48c1-98d1-9f8c83b31624 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:51.989642 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf12983b-f065-48c1-98d1-9f8c83b31624 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:51.990090 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf12983b-f065-48c1-98d1-9f8c83b31624 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:51.990513 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf12983b-f065-48c1-98d1-9f8c83b31624 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:52.138610 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-cf12983b-f065-48c1-98d1-9f8c83b31624 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:52.146532 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cf12983b-f065-48c1-98d1-9f8c83b31624 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1676 microversion: 2.1 time: 0.171568 Sep 06 21:20:52.147094 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 399/794] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:20:51 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:20:53.171162 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9161c141-c072-44f6-8ae4-fdf5c336ebfd tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:53.171721 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9161c141-c072-44f6-8ae4-fdf5c336ebfd tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:53.179103 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9161c141-c072-44f6-8ae4-fdf5c336ebfd tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:53.179581 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9161c141-c072-44f6-8ae4-fdf5c336ebfd tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:53.180015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9161c141-c072-44f6-8ae4-fdf5c336ebfd tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:53.180707 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9161c141-c072-44f6-8ae4-fdf5c336ebfd tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:53.181183 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9161c141-c072-44f6-8ae4-fdf5c336ebfd tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:53.181598 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9161c141-c072-44f6-8ae4-fdf5c336ebfd tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:53.333736 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9161c141-c072-44f6-8ae4-fdf5c336ebfd tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:53.346951 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9161c141-c072-44f6-8ae4-fdf5c336ebfd tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1676 microversion: 2.1 time: 0.179506 Sep 06 21:20:53.347844 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 396/795] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:20:53 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1676 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:20:54.379227 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b285a237-a0fb-4c26-b60d-6ecc00397e05 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:54.379894 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b285a237-a0fb-4c26-b60d-6ecc00397e05 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:54.389819 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b285a237-a0fb-4c26-b60d-6ecc00397e05 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:54.390460 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b285a237-a0fb-4c26-b60d-6ecc00397e05 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:54.390899 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b285a237-a0fb-4c26-b60d-6ecc00397e05 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:54.391979 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b285a237-a0fb-4c26-b60d-6ecc00397e05 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:54.392905 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b285a237-a0fb-4c26-b60d-6ecc00397e05 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:54.393836 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b285a237-a0fb-4c26-b60d-6ecc00397e05 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:54.544840 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b285a237-a0fb-4c26-b60d-6ecc00397e05 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:54.557918 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b285a237-a0fb-4c26-b60d-6ecc00397e05 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1676 microversion: 2.1 time: 0.185345 Sep 06 21:20:54.558711 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 400/796] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:20:54 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1676 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:20:55.589288 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a262f273-51f7-4744-8326-ba4d022127ab tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:55.590600 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a262f273-51f7-4744-8326-ba4d022127ab tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:55.597751 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a262f273-51f7-4744-8326-ba4d022127ab tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:55.598233 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a262f273-51f7-4744-8326-ba4d022127ab tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:55.598661 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a262f273-51f7-4744-8326-ba4d022127ab tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:55.599356 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a262f273-51f7-4744-8326-ba4d022127ab tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:55.599808 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a262f273-51f7-4744-8326-ba4d022127ab tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:55.600220 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a262f273-51f7-4744-8326-ba4d022127ab tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:55.739114 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a262f273-51f7-4744-8326-ba4d022127ab tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:55.747456 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a262f273-51f7-4744-8326-ba4d022127ab tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1676 microversion: 2.1 time: 0.162382 Sep 06 21:20:55.748046 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 397/797] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:20:55 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:20:56.770871 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-41209626-c5d3-4f52-9f4a-a2cedb17e5fe tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:56.771479 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-41209626-c5d3-4f52-9f4a-a2cedb17e5fe tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:56.778706 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41209626-c5d3-4f52-9f4a-a2cedb17e5fe tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:56.779185 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41209626-c5d3-4f52-9f4a-a2cedb17e5fe tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:56.779626 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41209626-c5d3-4f52-9f4a-a2cedb17e5fe tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:56.780353 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41209626-c5d3-4f52-9f4a-a2cedb17e5fe tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:56.780825 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41209626-c5d3-4f52-9f4a-a2cedb17e5fe tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:56.781252 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41209626-c5d3-4f52-9f4a-a2cedb17e5fe tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:56.915312 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-41209626-c5d3-4f52-9f4a-a2cedb17e5fe tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:56.923824 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-41209626-c5d3-4f52-9f4a-a2cedb17e5fe tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1676 microversion: 2.1 time: 0.156703 Sep 06 21:20:56.924404 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 401/798] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:20:56 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:20:57.950050 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8ffc6471-7ff6-41b7-ba5b-0dc095036fe4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:57.950636 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8ffc6471-7ff6-41b7-ba5b-0dc095036fe4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:57.956985 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ffc6471-7ff6-41b7-ba5b-0dc095036fe4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:57.957462 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ffc6471-7ff6-41b7-ba5b-0dc095036fe4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:57.957902 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ffc6471-7ff6-41b7-ba5b-0dc095036fe4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:57.958591 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ffc6471-7ff6-41b7-ba5b-0dc095036fe4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:57.959035 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ffc6471-7ff6-41b7-ba5b-0dc095036fe4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:57.959449 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ffc6471-7ff6-41b7-ba5b-0dc095036fe4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:58.097747 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8ffc6471-7ff6-41b7-ba5b-0dc095036fe4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:58.110233 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8ffc6471-7ff6-41b7-ba5b-0dc095036fe4 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1676 microversion: 2.1 time: 0.165279 Sep 06 21:20:58.110986 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 398/799] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:20:57 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:20:59.140689 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2e64233b-d6d8-4714-98bd-2a80ebc1e862 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:20:59.141310 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2e64233b-d6d8-4714-98bd-2a80ebc1e862 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:20:59.148297 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e64233b-d6d8-4714-98bd-2a80ebc1e862 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:59.148806 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e64233b-d6d8-4714-98bd-2a80ebc1e862 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:59.149257 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e64233b-d6d8-4714-98bd-2a80ebc1e862 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:59.149985 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e64233b-d6d8-4714-98bd-2a80ebc1e862 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:20:59.150440 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e64233b-d6d8-4714-98bd-2a80ebc1e862 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:20:59.150872 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e64233b-d6d8-4714-98bd-2a80ebc1e862 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:20:59.285033 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2e64233b-d6d8-4714-98bd-2a80ebc1e862 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:20:59.296443 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2e64233b-d6d8-4714-98bd-2a80ebc1e862 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1676 microversion: 2.1 time: 0.160968 Sep 06 21:20:59.297079 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 402/800] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:20:59 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:00.335227 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-30314bd2-6673-47b7-84da-38e2123b2c90 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:00.336502 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-30314bd2-6673-47b7-84da-38e2123b2c90 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:00.345390 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30314bd2-6673-47b7-84da-38e2123b2c90 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:00.345929 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30314bd2-6673-47b7-84da-38e2123b2c90 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:00.346366 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30314bd2-6673-47b7-84da-38e2123b2c90 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:00.347054 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30314bd2-6673-47b7-84da-38e2123b2c90 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:00.347496 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30314bd2-6673-47b7-84da-38e2123b2c90 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:00.347903 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30314bd2-6673-47b7-84da-38e2123b2c90 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:00.495020 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-30314bd2-6673-47b7-84da-38e2123b2c90 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:00.503886 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-30314bd2-6673-47b7-84da-38e2123b2c90 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1676 microversion: 2.1 time: 0.176202 Sep 06 21:21:00.504450 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 399/801] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:00 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:01.528725 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dab3f85b-49c0-4211-894b-9a16c14e69fb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:01.529350 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dab3f85b-49c0-4211-894b-9a16c14e69fb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:01.538275 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dab3f85b-49c0-4211-894b-9a16c14e69fb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:01.538951 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dab3f85b-49c0-4211-894b-9a16c14e69fb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:01.539537 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dab3f85b-49c0-4211-894b-9a16c14e69fb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:01.540510 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dab3f85b-49c0-4211-894b-9a16c14e69fb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:01.541082 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dab3f85b-49c0-4211-894b-9a16c14e69fb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:01.541509 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dab3f85b-49c0-4211-894b-9a16c14e69fb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:01.679451 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-dab3f85b-49c0-4211-894b-9a16c14e69fb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:01.687570 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dab3f85b-49c0-4211-894b-9a16c14e69fb tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1676 microversion: 2.1 time: 0.164598 Sep 06 21:21:01.688148 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 403/802] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:01 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:02.714916 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-364403cb-bd38-4aca-9ef9-393ed4b1ed13 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:02.715937 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-364403cb-bd38-4aca-9ef9-393ed4b1ed13 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:02.724798 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-364403cb-bd38-4aca-9ef9-393ed4b1ed13 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:02.725297 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-364403cb-bd38-4aca-9ef9-393ed4b1ed13 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:02.725760 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-364403cb-bd38-4aca-9ef9-393ed4b1ed13 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:02.726440 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-364403cb-bd38-4aca-9ef9-393ed4b1ed13 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:02.726890 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-364403cb-bd38-4aca-9ef9-393ed4b1ed13 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:02.727302 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-364403cb-bd38-4aca-9ef9-393ed4b1ed13 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:02.873603 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-364403cb-bd38-4aca-9ef9-393ed4b1ed13 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:02.884806 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-364403cb-bd38-4aca-9ef9-393ed4b1ed13 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1676 microversion: 2.1 time: 0.176064 Sep 06 21:21:02.885644 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 400/803] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:02 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:03.912574 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a2dac9a4-2804-45bf-a094-894c7008a4b6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:03.913192 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a2dac9a4-2804-45bf-a094-894c7008a4b6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:03.920091 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2dac9a4-2804-45bf-a094-894c7008a4b6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:03.920575 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2dac9a4-2804-45bf-a094-894c7008a4b6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:03.921034 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2dac9a4-2804-45bf-a094-894c7008a4b6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:03.921737 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2dac9a4-2804-45bf-a094-894c7008a4b6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:03.922185 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2dac9a4-2804-45bf-a094-894c7008a4b6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:03.922968 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a2dac9a4-2804-45bf-a094-894c7008a4b6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:04.062471 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a2dac9a4-2804-45bf-a094-894c7008a4b6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:04.070494 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a2dac9a4-2804-45bf-a094-894c7008a4b6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1676 microversion: 2.1 time: 0.162267 Sep 06 21:21:04.071091 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 404/804] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:03 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:05.094428 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0adc0432-84b7-4495-a1d8-e349b16589fa tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:05.095122 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0adc0432-84b7-4495-a1d8-e349b16589fa tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:05.101954 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0adc0432-84b7-4495-a1d8-e349b16589fa tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:05.102429 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0adc0432-84b7-4495-a1d8-e349b16589fa tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:05.102854 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0adc0432-84b7-4495-a1d8-e349b16589fa tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:05.103560 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0adc0432-84b7-4495-a1d8-e349b16589fa tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:05.104000 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0adc0432-84b7-4495-a1d8-e349b16589fa tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:05.104435 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0adc0432-84b7-4495-a1d8-e349b16589fa tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:05.240376 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0adc0432-84b7-4495-a1d8-e349b16589fa tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:05.253893 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0adc0432-84b7-4495-a1d8-e349b16589fa tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1653 microversion: 2.1 time: 0.163191 Sep 06 21:21:05.254771 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 401/805] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:05 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1653 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:05.281263 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4bed4716-db23-49ac-80a2-50881ae6f931 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:21:05.288151 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4bed4716-db23-49ac-80a2-50881ae6f931 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:05.288635 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4bed4716-db23-49ac-80a2-50881ae6f931 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:05.289092 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4bed4716-db23-49ac-80a2-50881ae6f931 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:05.313276 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4bed4716-db23-49ac-80a2-50881ae6f931 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Going to try to start instance {{(pid=120719) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 06 21:21:05.364863 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4bed4716-db23-49ac-80a2-50881ae6f931 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "POST /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f/action" status: 202 len: 0 microversion: 2.1 time: 0.087384 Sep 06 21:21:05.365453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 405/806] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Sep 6 21:21:05 2022] POST /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 21:21:05.373842 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-969567c4-b4e0-46af-bfe0-368acb6a719e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:05.374419 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-969567c4-b4e0-46af-bfe0-368acb6a719e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:05.380735 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-969567c4-b4e0-46af-bfe0-368acb6a719e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:05.381235 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-969567c4-b4e0-46af-bfe0-368acb6a719e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:05.381665 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-969567c4-b4e0-46af-bfe0-368acb6a719e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:05.382434 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-969567c4-b4e0-46af-bfe0-368acb6a719e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:05.383044 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-969567c4-b4e0-46af-bfe0-368acb6a719e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:05.383522 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-969567c4-b4e0-46af-bfe0-368acb6a719e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:05.807879 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-969567c4-b4e0-46af-bfe0-368acb6a719e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:05.816604 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-969567c4-b4e0-46af-bfe0-368acb6a719e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1662 microversion: 2.1 time: 0.446621 Sep 06 21:21:05.817229 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 402/807] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:05 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1662 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:06.845160 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2ffa2341-940a-4091-8d5a-bf05cb2eb6f7 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:06.845984 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2ffa2341-940a-4091-8d5a-bf05cb2eb6f7 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:06.855517 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ffa2341-940a-4091-8d5a-bf05cb2eb6f7 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:06.856213 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ffa2341-940a-4091-8d5a-bf05cb2eb6f7 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:06.856950 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ffa2341-940a-4091-8d5a-bf05cb2eb6f7 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:06.858448 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ffa2341-940a-4091-8d5a-bf05cb2eb6f7 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:06.859093 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ffa2341-940a-4091-8d5a-bf05cb2eb6f7 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:06.859701 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ffa2341-940a-4091-8d5a-bf05cb2eb6f7 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:07.005385 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2ffa2341-940a-4091-8d5a-bf05cb2eb6f7 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:07.017208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2ffa2341-940a-4091-8d5a-bf05cb2eb6f7 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1662 microversion: 2.1 time: 0.178680 Sep 06 21:21:07.018141 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 406/808] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:06 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1662 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:08.052484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7aa51480-e0a3-4161-8ae7-725ae69e029c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:08.053121 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7aa51480-e0a3-4161-8ae7-725ae69e029c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:08.060238 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7aa51480-e0a3-4161-8ae7-725ae69e029c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:08.060774 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7aa51480-e0a3-4161-8ae7-725ae69e029c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:08.061236 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7aa51480-e0a3-4161-8ae7-725ae69e029c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:08.061922 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7aa51480-e0a3-4161-8ae7-725ae69e029c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:08.062370 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7aa51480-e0a3-4161-8ae7-725ae69e029c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:08.062784 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7aa51480-e0a3-4161-8ae7-725ae69e029c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:08.211990 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7aa51480-e0a3-4161-8ae7-725ae69e029c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:08.223548 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7aa51480-e0a3-4161-8ae7-725ae69e029c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1666 microversion: 2.1 time: 0.175826 Sep 06 21:21:08.224321 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 403/809] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:08 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1666 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:11.384532 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-839c2903-a75d-49cf-8523-27683f4b055b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:11.385214 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-839c2903-a75d-49cf-8523-27683f4b055b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:11.392688 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-839c2903-a75d-49cf-8523-27683f4b055b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:11.393195 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-839c2903-a75d-49cf-8523-27683f4b055b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:11.393649 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-839c2903-a75d-49cf-8523-27683f4b055b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:11.394385 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-839c2903-a75d-49cf-8523-27683f4b055b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:11.394858 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-839c2903-a75d-49cf-8523-27683f4b055b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:11.395304 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-839c2903-a75d-49cf-8523-27683f4b055b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:11.433685 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-839c2903-a75d-49cf-8523-27683f4b055b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650/os-volume_attachments/0b8eeae6-67cb-4679-8052-cd6ce60a9e52" status: 200 len: 194 microversion: 2.20 time: 0.053145 Sep 06 21:21:11.434414 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 407/810] 10.222.0.79 () {60 vars in 1454 bytes} [Tue Sep 6 21:21:11 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650/os-volume_attachments/0b8eeae6-67cb-4679-8052-cd6ce60a9e52 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 21:21:11.521331 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-86599edc-e15c-47d1-8ec3-8cd79bfb0bac tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:11.521916 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-86599edc-e15c-47d1-8ec3-8cd79bfb0bac tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:11.528752 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86599edc-e15c-47d1-8ec3-8cd79bfb0bac tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:11.529234 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86599edc-e15c-47d1-8ec3-8cd79bfb0bac tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:11.529670 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86599edc-e15c-47d1-8ec3-8cd79bfb0bac tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:11.530371 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86599edc-e15c-47d1-8ec3-8cd79bfb0bac tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:11.530824 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86599edc-e15c-47d1-8ec3-8cd79bfb0bac tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:11.531240 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86599edc-e15c-47d1-8ec3-8cd79bfb0bac tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:11.625219 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-86599edc-e15c-47d1-8ec3-8cd79bfb0bac tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lazy-loading 'services' on Instance uuid 8fea1aa0-032e-454d-9358-98a81cd5d650 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:21:11.723104 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-86599edc-e15c-47d1-8ec3-8cd79bfb0bac tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650/os-volume_attachments/0b8eeae6-67cb-4679-8052-cd6ce60a9e52" status: 202 len: 0 microversion: 2.20 time: 0.205334 Sep 06 21:21:11.723764 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 404/811] 10.222.0.79 () {60 vars in 1457 bytes} [Tue Sep 6 21:21:11 2022] DELETE /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650/os-volume_attachments/0b8eeae6-67cb-4679-8052-cd6ce60a9e52 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 21:21:11.733355 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-389e59a7-38f9-4909-9f4f-08bbf22c390f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:11.735434 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-389e59a7-38f9-4909-9f4f-08bbf22c390f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:11.742080 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-389e59a7-38f9-4909-9f4f-08bbf22c390f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:11.742561 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-389e59a7-38f9-4909-9f4f-08bbf22c390f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:11.742980 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-389e59a7-38f9-4909-9f4f-08bbf22c390f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:11.743683 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-389e59a7-38f9-4909-9f4f-08bbf22c390f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:11.744373 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-389e59a7-38f9-4909-9f4f-08bbf22c390f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:11.744855 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-389e59a7-38f9-4909-9f4f-08bbf22c390f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:11.775756 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-389e59a7-38f9-4909-9f4f-08bbf22c390f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047295 Sep 06 21:21:11.776648 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 408/812] 10.222.0.79 () {60 vars in 1343 bytes} [Tue Sep 6 21:21:11 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 21:21:12.791451 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ba002021-ac27-4d81-a7d8-d2e75c36ab79 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:12.793914 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ba002021-ac27-4d81-a7d8-d2e75c36ab79 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:12.801327 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba002021-ac27-4d81-a7d8-d2e75c36ab79 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:12.801821 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba002021-ac27-4d81-a7d8-d2e75c36ab79 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:12.802256 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba002021-ac27-4d81-a7d8-d2e75c36ab79 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:12.802956 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba002021-ac27-4d81-a7d8-d2e75c36ab79 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:12.803401 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba002021-ac27-4d81-a7d8-d2e75c36ab79 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:12.803823 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba002021-ac27-4d81-a7d8-d2e75c36ab79 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:12.834143 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ba002021-ac27-4d81-a7d8-d2e75c36ab79 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047763 Sep 06 21:21:12.834945 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 405/813] 10.222.0.79 () {60 vars in 1343 bytes} [Tue Sep 6 21:21:12 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:12.897295 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0d157049-9f8d-481c-976f-e049b0276e78 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:12.897849 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0d157049-9f8d-481c-976f-e049b0276e78 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:12.904152 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d157049-9f8d-481c-976f-e049b0276e78 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:12.904618 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d157049-9f8d-481c-976f-e049b0276e78 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:12.905076 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d157049-9f8d-481c-976f-e049b0276e78 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:12.905760 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d157049-9f8d-481c-976f-e049b0276e78 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:12.906199 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d157049-9f8d-481c-976f-e049b0276e78 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:12.906588 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d157049-9f8d-481c-976f-e049b0276e78 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:12.934043 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0d157049-9f8d-481c-976f-e049b0276e78 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 21:21:13.028374 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0d157049-9f8d-481c-976f-e049b0276e78 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 204 len: 0 microversion: 2.20 time: 0.134586 Sep 06 21:21:13.028969 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 409/814] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Sep 6 21:21:12 2022] DELETE /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 21:21:13.037792 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-83ab99f4-cbed-4514-9e15-b8b172f8564a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:13.038397 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-83ab99f4-cbed-4514-9e15-b8b172f8564a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:13.045475 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83ab99f4-cbed-4514-9e15-b8b172f8564a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:13.045950 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83ab99f4-cbed-4514-9e15-b8b172f8564a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:13.046379 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83ab99f4-cbed-4514-9e15-b8b172f8564a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:13.047100 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83ab99f4-cbed-4514-9e15-b8b172f8564a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:13.047905 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83ab99f4-cbed-4514-9e15-b8b172f8564a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:13.048318 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83ab99f4-cbed-4514-9e15-b8b172f8564a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:13.191360 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-83ab99f4-cbed-4514-9e15-b8b172f8564a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:13.200447 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-83ab99f4-cbed-4514-9e15-b8b172f8564a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:13.201969 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-83ab99f4-cbed-4514-9e15-b8b172f8564a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:13.203269 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-83ab99f4-cbed-4514-9e15-b8b172f8564a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1723 microversion: 2.20 time: 0.169545 Sep 06 21:21:13.203863 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 406/815] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:21:13 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:21:14.230223 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f99581e2-bde0-41cc-be95-25611199f5e8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:14.230969 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f99581e2-bde0-41cc-be95-25611199f5e8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:14.240307 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f99581e2-bde0-41cc-be95-25611199f5e8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:14.240814 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f99581e2-bde0-41cc-be95-25611199f5e8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:14.241244 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f99581e2-bde0-41cc-be95-25611199f5e8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:14.241934 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f99581e2-bde0-41cc-be95-25611199f5e8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:14.242383 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f99581e2-bde0-41cc-be95-25611199f5e8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:14.242800 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f99581e2-bde0-41cc-be95-25611199f5e8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:14.246894 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:21:14.393850 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f99581e2-bde0-41cc-be95-25611199f5e8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:14.405371 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f99581e2-bde0-41cc-be95-25611199f5e8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:14.407188 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f99581e2-bde0-41cc-be95-25611199f5e8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:14.408721 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f99581e2-bde0-41cc-be95-25611199f5e8 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1723 microversion: 2.20 time: 0.182862 Sep 06 21:21:14.409664 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 410/816] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:21:14 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:21:15.437014 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-40fceba7-7ca0-4a9d-afa2-ccb6c3510cf4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:15.437707 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-40fceba7-7ca0-4a9d-afa2-ccb6c3510cf4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:15.444997 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40fceba7-7ca0-4a9d-afa2-ccb6c3510cf4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:15.445486 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40fceba7-7ca0-4a9d-afa2-ccb6c3510cf4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:15.445917 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40fceba7-7ca0-4a9d-afa2-ccb6c3510cf4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:15.446679 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40fceba7-7ca0-4a9d-afa2-ccb6c3510cf4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:15.447132 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40fceba7-7ca0-4a9d-afa2-ccb6c3510cf4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:15.447555 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40fceba7-7ca0-4a9d-afa2-ccb6c3510cf4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:15.687382 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-40fceba7-7ca0-4a9d-afa2-ccb6c3510cf4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:15.696607 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-40fceba7-7ca0-4a9d-afa2-ccb6c3510cf4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:15.698239 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-40fceba7-7ca0-4a9d-afa2-ccb6c3510cf4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:15.699429 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-40fceba7-7ca0-4a9d-afa2-ccb6c3510cf4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1723 microversion: 2.20 time: 0.266670 Sep 06 21:21:15.700103 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 407/817] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:21:15 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:21:16.262565 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-8ad26e34-415d-4e6b-9fab-62c10dc22839 req-cc2494e0-d97d-4d2c-aeb4-f0051c6d7e78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fea1aa0-032e-454d-9358-98a81cd5d650", "name": "network-vif-deleted", "tag": "7ea4447f-6e97-421a-ae16-09790d6651e8"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:21:16.273922 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8ad26e34-415d-4e6b-9fab-62c10dc22839 req-cc2494e0-d97d-4d2c-aeb4-f0051c6d7e78 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:16.275536 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8ad26e34-415d-4e6b-9fab-62c10dc22839 req-cc2494e0-d97d-4d2c-aeb4-f0051c6d7e78 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:16.275990 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8ad26e34-415d-4e6b-9fab-62c10dc22839 req-cc2494e0-d97d-4d2c-aeb4-f0051c6d7e78 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:16.288540 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-8ad26e34-415d-4e6b-9fab-62c10dc22839 req-cc2494e0-d97d-4d2c-aeb4-f0051c6d7e78 service nova] Creating event network-vif-deleted:7ea4447f-6e97-421a-ae16-09790d6651e8 for instance 8fea1aa0-032e-454d-9358-98a81cd5d650 on hv-cinder-74915 Sep 06 21:21:16.294082 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-8ad26e34-415d-4e6b-9fab-62c10dc22839 req-cc2494e0-d97d-4d2c-aeb4-f0051c6d7e78 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180672 Sep 06 21:21:16.294863 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 411/818] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:21:16.725462 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-00516229-4007-4094-b634-d8e46ab1f7cb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:16.726142 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-00516229-4007-4094-b634-d8e46ab1f7cb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:16.733265 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00516229-4007-4094-b634-d8e46ab1f7cb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:16.733728 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00516229-4007-4094-b634-d8e46ab1f7cb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:16.734135 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00516229-4007-4094-b634-d8e46ab1f7cb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:16.734989 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00516229-4007-4094-b634-d8e46ab1f7cb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:16.735627 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00516229-4007-4094-b634-d8e46ab1f7cb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:16.736210 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00516229-4007-4094-b634-d8e46ab1f7cb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:16.773134 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00516229-4007-4094-b634-d8e46ab1f7cb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:16.773763 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00516229-4007-4094-b634-d8e46ab1f7cb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:16.774563 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00516229-4007-4094-b634-d8e46ab1f7cb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:16.775115 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-00516229-4007-4094-b634-d8e46ab1f7cb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lazy-loading 'fault' on Instance uuid 8fea1aa0-032e-454d-9358-98a81cd5d650 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:21:16.779665 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:21:16.824205 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-00516229-4007-4094-b634-d8e46ab1f7cb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:16.833536 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-00516229-4007-4094-b634-d8e46ab1f7cb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:16.834971 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-00516229-4007-4094-b634-d8e46ab1f7cb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:16.836741 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-00516229-4007-4094-b634-d8e46ab1f7cb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 200 len: 1372 microversion: 2.20 time: 0.115594 Sep 06 21:21:16.838146 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 408/819] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:21:16 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 1372 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:21:17.867450 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fe1f5cc8-3108-454e-91f5-b30f9b28316c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:17.868182 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fe1f5cc8-3108-454e-91f5-b30f9b28316c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:17.875493 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe1f5cc8-3108-454e-91f5-b30f9b28316c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:17.876004 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe1f5cc8-3108-454e-91f5-b30f9b28316c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:17.876458 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe1f5cc8-3108-454e-91f5-b30f9b28316c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:17.877230 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe1f5cc8-3108-454e-91f5-b30f9b28316c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:17.877710 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe1f5cc8-3108-454e-91f5-b30f9b28316c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:17.878181 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe1f5cc8-3108-454e-91f5-b30f9b28316c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:17.892629 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-fe1f5cc8-3108-454e-91f5-b30f9b28316c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] HTTP exception thrown: Instance 8fea1aa0-032e-454d-9358-98a81cd5d650 could not be found. Sep 06 21:21:17.894474 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fe1f5cc8-3108-454e-91f5-b30f9b28316c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Request method failure captured: Sep 06 21:21:17.894474 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 HTTP/1.1 Sep 06 21:21:17.894474 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:21:17.894474 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:21:17.894474 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:21:17.894474 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:21:17.894474 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:21:17.894474 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:21:17.894474 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:21:17.894474 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:21:17.894474 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7gRf8alxX1BmUMrmHhnD4zgzkcOMnoxdEBr5jOU86p2grAFeVa1tmlfeQXBdImGrz2RjefC5ZtMwh6QscByuLVxfRsnmCE6LsmTrbODQVyQbaVxUIUMbxTgHeZ_dyD5-x-316bs8zp3WkSAWcjs6kP6cXtvTjd4pMGov7pahmoRW2w Sep 06 21:21:17.894474 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:21:17.894474 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:21:17.894474 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:21:17.894474 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:21:17.894474 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 21:21:17.894474 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:21:17.894474 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:21:17.894474 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: 2e39683d687e424fbed4539cb4040060 Sep 06 21:21:17.894474 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-66209968 Sep 06 21:21:17.894474 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:21:17.894474 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:21:17.896301 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2e39683d687e424fbed4539cb4040060"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2e39683d687e424fbed4539cb4040060", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2e39683d687e424fbed4539cb4040060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2e39683d687e424fbed4539cb4040060"}]}] Sep 06 21:21:17.896301 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeShelveTestJSON-66209968 Sep 06 21:21:17.896301 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 2e39683d687e424fbed4539cb4040060 Sep 06 21:21:17.896301 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-66209968 Sep 06 21:21:17.896301 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeShelveTestJSON-66209968-project Sep 06 21:21:17.896301 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:21:17.896301 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:21:17.896301 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: 54fe3d99f05c45f099804fccb4679503 Sep 06 21:21:17.896301 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeShelveTestJSON-66209968-project Sep 06 21:21:17.896301 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: > Sep 06 21:21:17.896301 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Instance 8fea1aa0-032e-454d-9358-98a81cd5d650 could not be found. Sep 06 21:21:17.896301 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'id': '8fea1aa0-032e-454d-9358-98a81cd5d650'} Sep 06 21:21:17.897299 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:21:17.897299 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:21:17.897299 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:21:17.897299 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:21:17.897299 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:21:17.897299 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:21:17.897299 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:21:17.897299 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:21:17.897299 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:21:17.897299 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:21:17.897299 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fea1aa0-032e-454d-9358-98a81cd5d650 could not be found. Sep 06 21:21:17.897299 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:21:17.897299 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:21:17.897299 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:21:17.897299 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:21:17.897299 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:21:17.897299 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:21:17.897299 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:21:17.897299 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:21:17.897299 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:21:17.898792 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:21:17.898792 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:21:17.898792 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:21:17.898792 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:21:17.898792 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:21:17.898792 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:21:17.898792 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:21:17.898792 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fea1aa0-032e-454d-9358-98a81cd5d650 could not be found. Sep 06 21:21:17.898792 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:21:17.898792 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:21:17.898792 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:21:17.898792 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:21:17.898792 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:21:17.898792 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:21:17.898792 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:21:17.898792 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:21:17.898792 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fea1aa0-032e-454d-9358-98a81cd5d650 could not be found. Sep 06 21:21:17.898792 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:21:17.900110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fe1f5cc8-3108-454e-91f5-b30f9b28316c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Returning 404 to user: Instance 8fea1aa0-032e-454d-9358-98a81cd5d650 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:21:17.900110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fe1f5cc8-3108-454e-91f5-b30f9b28316c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 404 len: 111 microversion: 2.20 time: 0.035184 Sep 06 21:21:17.900110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 412/820] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:21:17 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 21:21:17.907807 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1015aca1-b118-4886-8be0-58548b53f1f2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '.version_select at 0x7f04ce518550>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:17.938495 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1015aca1-b118-4886-8be0-58548b53f1f2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1797284754" status: 204 len: 0 microversion: 2.20 time: 0.036869 Sep 06 21:21:17.938989 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 409/821] 10.222.0.79 () {60 vars in 1262 bytes} [Tue Sep 6 21:21:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1797284754 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 21:21:18.617899 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fac38cc9-69ff-4119-b5aa-587b9a780b3a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Action: 'create', calling method: .version_select at 0x7f04ce65d8b0>, body: {"keypair": {"name": "tempest-keypair-2110135943", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEFcUccVKIeLuFyaq2wZ6eMBNFXIMge0Wa1QWMUiG4L6G6jtH5FxX4gbmfiilwXrpBF79lpuOnQ8tR0me2VoL+oZ0SmP0x11p/S9zL0Ff6qRSID18bs6InTnLAQvTRq0A=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:21:18.623217 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:21:18.635870 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-fac38cc9-69ff-4119-b5aa-587b9a780b3a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Getting quotas for project 2e39683d687e424fbed4539cb4040060. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:21:18.641286 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-fac38cc9-69ff-4119-b5aa-587b9a780b3a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Getting quotas for user 54fe3d99f05c45f099804fccb4679503 and project 2e39683d687e424fbed4539cb4040060. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:21:18.653701 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fac38cc9-69ff-4119-b5aa-587b9a780b3a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [8707d9d8-c38f-4a29-975f-7f51aa5ae215] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 06 21:21:19.665440 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [None req-fac38cc9-69ff-4119-b5aa-587b9a780b3a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [8707d9d8-c38f-4a29-975f-7f51aa5ae215] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 37498. Sep 06 21:21:19.686950 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fac38cc9-69ff-4119-b5aa-587b9a780b3a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.075885 Sep 06 21:21:19.687852 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 413/822] 10.222.0.79 () {62 vars in 1200 bytes} [Tue Sep 6 21:21:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1078 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 06 21:21:21.148221 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a4282dfa-1ced-4c6a-90d8-0c09e6db4901 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2000335645", "imageRef": "8b4a7612-517c-4711-8637-36b221338f65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8251999f-dd53-4ed2-8c61-ea9e082ce54a"}], "security_groups": [{"name": "tempest-securitygroup--465467540"}], "key_name": "tempest-keypair-2110135943", "user_data": "}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:21:21.161855 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:21:21.264565 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-a4282dfa-1ced-4c6a-90d8-0c09e6db4901 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] validate_networks() for [('8251999f-dd53-4ed2-8c61-ea9e082ce54a', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 21:21:21.760284 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-a4282dfa-1ced-4c6a-90d8-0c09e6db4901 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 21:21:21.760870 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-a4282dfa-1ced-4c6a-90d8-0c09e6db4901 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 21:21:21.761514 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-a4282dfa-1ced-4c6a-90d8-0c09e6db4901 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 21:21:21.762012 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-a4282dfa-1ced-4c6a-90d8-0c09e6db4901 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 21:21:21.762525 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-a4282dfa-1ced-4c6a-90d8-0c09e6db4901 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 21:21:21.774500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4282dfa-1ced-4c6a-90d8-0c09e6db4901 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:21.774970 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4282dfa-1ced-4c6a-90d8-0c09e6db4901 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:21.775419 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4282dfa-1ced-4c6a-90d8-0c09e6db4901 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:21.776136 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4282dfa-1ced-4c6a-90d8-0c09e6db4901 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:21.776579 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4282dfa-1ced-4c6a-90d8-0c09e6db4901 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:21.777041 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4282dfa-1ced-4c6a-90d8-0c09e6db4901 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:21.795109 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-a4282dfa-1ced-4c6a-90d8-0c09e6db4901 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Getting quotas for project 2e39683d687e424fbed4539cb4040060. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:21:21.800038 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-a4282dfa-1ced-4c6a-90d8-0c09e6db4901 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Getting quotas for user 54fe3d99f05c45f099804fccb4679503 and project 2e39683d687e424fbed4539cb4040060. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:21:21.818119 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a4282dfa-1ced-4c6a-90d8-0c09e6db4901 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 21:21:21.820465 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a4282dfa-1ced-4c6a-90d8-0c09e6db4901 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8b4a7612-517c-4711-8637-36b221338f65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 21:21:21.872307 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a4282dfa-1ced-4c6a-90d8-0c09e6db4901 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.732345 Sep 06 21:21:21.873011 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 410/823] 10.222.0.79 () {62 vars in 1188 bytes} [Tue Sep 6 21:21:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 06 21:21:21.884928 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cf2919f5-cc36-40fc-b18d-97fc1f6d0a7d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:21.885535 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cf2919f5-cc36-40fc-b18d-97fc1f6d0a7d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:21.944346 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-cf2919f5-cc36-40fc-b18d-97fc1f6d0a7d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:21.953185 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-cf2919f5-cc36-40fc-b18d-97fc1f6d0a7d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:21.954956 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-cf2919f5-cc36-40fc-b18d-97fc1f6d0a7d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:21.956034 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cf2919f5-cc36-40fc-b18d-97fc1f6d0a7d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1282 microversion: 2.20 time: 0.075368 Sep 06 21:21:21.956600 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 414/824] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:21:21 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1282 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:21:22.984986 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e7b32b8f-6094-42e8-9a97-f4d42bff43d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:22.985547 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e7b32b8f-6094-42e8-9a97-f4d42bff43d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:22.993654 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7b32b8f-6094-42e8-9a97-f4d42bff43d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:22.994154 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7b32b8f-6094-42e8-9a97-f4d42bff43d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:22.994583 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7b32b8f-6094-42e8-9a97-f4d42bff43d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:22.995266 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7b32b8f-6094-42e8-9a97-f4d42bff43d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:22.995708 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7b32b8f-6094-42e8-9a97-f4d42bff43d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:22.996122 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7b32b8f-6094-42e8-9a97-f4d42bff43d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:23.061038 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e7b32b8f-6094-42e8-9a97-f4d42bff43d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:23.069656 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e7b32b8f-6094-42e8-9a97-f4d42bff43d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:23.071068 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e7b32b8f-6094-42e8-9a97-f4d42bff43d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:23.072222 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e7b32b8f-6094-42e8-9a97-f4d42bff43d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1334 microversion: 2.20 time: 0.094456 Sep 06 21:21:23.072709 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 411/825] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:21:22 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1334 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:21:24.101250 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e27735f1-6b89-4922-b6e5-1222bf12d6e3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:24.101841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e27735f1-6b89-4922-b6e5-1222bf12d6e3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:24.110605 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e27735f1-6b89-4922-b6e5-1222bf12d6e3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:24.111104 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e27735f1-6b89-4922-b6e5-1222bf12d6e3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:24.111562 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e27735f1-6b89-4922-b6e5-1222bf12d6e3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:24.112486 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e27735f1-6b89-4922-b6e5-1222bf12d6e3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:24.113392 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e27735f1-6b89-4922-b6e5-1222bf12d6e3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:24.114084 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e27735f1-6b89-4922-b6e5-1222bf12d6e3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:24.262466 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e27735f1-6b89-4922-b6e5-1222bf12d6e3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:24.272649 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e27735f1-6b89-4922-b6e5-1222bf12d6e3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:24.274128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e27735f1-6b89-4922-b6e5-1222bf12d6e3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:24.275562 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e27735f1-6b89-4922-b6e5-1222bf12d6e3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1407 microversion: 2.20 time: 0.178473 Sep 06 21:21:24.285830 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 415/826] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:21:24 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:21:24.812482 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a8b15f28-900b-43a7-90a3-8151a5bba239 req-c9b1d0d9-5aff-4243-a842-52f9897d6f1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8066f708-d355-454f-b0fd-7b33e51e265e", "tag": "d805515a-5f19-4507-b89b-93b54084b935"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:21:24.823604 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a8b15f28-900b-43a7-90a3-8151a5bba239 req-c9b1d0d9-5aff-4243-a842-52f9897d6f1e service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:24.824422 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a8b15f28-900b-43a7-90a3-8151a5bba239 req-c9b1d0d9-5aff-4243-a842-52f9897d6f1e service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:24.824839 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a8b15f28-900b-43a7-90a3-8151a5bba239 req-c9b1d0d9-5aff-4243-a842-52f9897d6f1e service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:24.836412 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a8b15f28-900b-43a7-90a3-8151a5bba239 req-c9b1d0d9-5aff-4243-a842-52f9897d6f1e service nova] Creating event network-changed:d805515a-5f19-4507-b89b-93b54084b935 for instance 8066f708-d355-454f-b0fd-7b33e51e265e on hv-cinder-74915 Sep 06 21:21:24.841354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a8b15f28-900b-43a7-90a3-8151a5bba239 req-c9b1d0d9-5aff-4243-a842-52f9897d6f1e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032526 Sep 06 21:21:24.841947 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 412/827] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:21:25.303261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e787f514-2b4d-469b-859b-1bc6dd2fc2d6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:25.303893 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e787f514-2b4d-469b-859b-1bc6dd2fc2d6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:25.310609 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e787f514-2b4d-469b-859b-1bc6dd2fc2d6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:25.311088 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e787f514-2b4d-469b-859b-1bc6dd2fc2d6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:25.311532 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e787f514-2b4d-469b-859b-1bc6dd2fc2d6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:25.312249 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e787f514-2b4d-469b-859b-1bc6dd2fc2d6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:25.312685 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e787f514-2b4d-469b-859b-1bc6dd2fc2d6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:25.313147 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e787f514-2b4d-469b-859b-1bc6dd2fc2d6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:25.444106 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e787f514-2b4d-469b-859b-1bc6dd2fc2d6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:25.452969 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e787f514-2b4d-469b-859b-1bc6dd2fc2d6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:25.454414 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e787f514-2b4d-469b-859b-1bc6dd2fc2d6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:25.455536 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e787f514-2b4d-469b-859b-1bc6dd2fc2d6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1407 microversion: 2.20 time: 0.156760 Sep 06 21:21:25.456098 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 416/828] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:21:25 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:21:26.482757 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-50d6b63c-9f99-4280-a883-2dc2e31945cc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:26.483491 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-50d6b63c-9f99-4280-a883-2dc2e31945cc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:26.490791 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50d6b63c-9f99-4280-a883-2dc2e31945cc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:26.491479 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50d6b63c-9f99-4280-a883-2dc2e31945cc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:26.492171 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50d6b63c-9f99-4280-a883-2dc2e31945cc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:26.493002 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50d6b63c-9f99-4280-a883-2dc2e31945cc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:26.493463 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50d6b63c-9f99-4280-a883-2dc2e31945cc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:26.493903 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50d6b63c-9f99-4280-a883-2dc2e31945cc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:26.886660 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-50d6b63c-9f99-4280-a883-2dc2e31945cc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:26.895524 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-50d6b63c-9f99-4280-a883-2dc2e31945cc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:26.897085 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-50d6b63c-9f99-4280-a883-2dc2e31945cc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:26.898198 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-50d6b63c-9f99-4280-a883-2dc2e31945cc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1407 microversion: 2.20 time: 0.420643 Sep 06 21:21:26.898787 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 413/829] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:21:26 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1407 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:21:27.923758 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0ec068ed-d685-4f4f-a4cb-891bf9b7efe2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:27.924367 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0ec068ed-d685-4f4f-a4cb-891bf9b7efe2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:27.934868 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ec068ed-d685-4f4f-a4cb-891bf9b7efe2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:27.935732 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ec068ed-d685-4f4f-a4cb-891bf9b7efe2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:27.936439 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ec068ed-d685-4f4f-a4cb-891bf9b7efe2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:27.937521 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ec068ed-d685-4f4f-a4cb-891bf9b7efe2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:27.938090 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ec068ed-d685-4f4f-a4cb-891bf9b7efe2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:27.938533 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ec068ed-d685-4f4f-a4cb-891bf9b7efe2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:28.086605 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0ec068ed-d685-4f4f-a4cb-891bf9b7efe2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:28.094927 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0ec068ed-d685-4f4f-a4cb-891bf9b7efe2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:28.096378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0ec068ed-d685-4f4f-a4cb-891bf9b7efe2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:28.098041 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0ec068ed-d685-4f4f-a4cb-891bf9b7efe2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1407 microversion: 2.20 time: 0.178226 Sep 06 21:21:28.098193 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 417/830] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:21:27 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:21:29.125229 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-54025d6a-1b53-4e5d-b7f7-438fc570c7d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:29.125952 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-54025d6a-1b53-4e5d-b7f7-438fc570c7d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:29.133312 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54025d6a-1b53-4e5d-b7f7-438fc570c7d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:29.133849 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54025d6a-1b53-4e5d-b7f7-438fc570c7d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:29.134448 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54025d6a-1b53-4e5d-b7f7-438fc570c7d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:29.135315 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54025d6a-1b53-4e5d-b7f7-438fc570c7d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:29.135814 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54025d6a-1b53-4e5d-b7f7-438fc570c7d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:29.136287 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54025d6a-1b53-4e5d-b7f7-438fc570c7d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:29.278697 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-54025d6a-1b53-4e5d-b7f7-438fc570c7d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:29.292283 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-54025d6a-1b53-4e5d-b7f7-438fc570c7d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:29.294987 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-54025d6a-1b53-4e5d-b7f7-438fc570c7d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:29.296828 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-54025d6a-1b53-4e5d-b7f7-438fc570c7d4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1407 microversion: 2.20 time: 0.175885 Sep 06 21:21:29.298093 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 414/831] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:21:29 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:21:29.878381 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-3a9cc23a-ad40-499d-94de-ee58d95c56d6 req-c73700d6-52b7-44b0-b1b0-54f48a2ce4cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8066f708-d355-454f-b0fd-7b33e51e265e", "name": "network-vif-plugged", "status": "completed", "tag": "d805515a-5f19-4507-b89b-93b54084b935"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:21:29.889802 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3a9cc23a-ad40-499d-94de-ee58d95c56d6 req-c73700d6-52b7-44b0-b1b0-54f48a2ce4cb service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:29.890317 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3a9cc23a-ad40-499d-94de-ee58d95c56d6 req-c73700d6-52b7-44b0-b1b0-54f48a2ce4cb service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:29.890769 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3a9cc23a-ad40-499d-94de-ee58d95c56d6 req-c73700d6-52b7-44b0-b1b0-54f48a2ce4cb service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:29.904293 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-3a9cc23a-ad40-499d-94de-ee58d95c56d6 req-c73700d6-52b7-44b0-b1b0-54f48a2ce4cb service nova] Creating event network-vif-plugged:d805515a-5f19-4507-b89b-93b54084b935 for instance 8066f708-d355-454f-b0fd-7b33e51e265e on hv-cinder-74915 Sep 06 21:21:29.909831 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-3a9cc23a-ad40-499d-94de-ee58d95c56d6 req-c73700d6-52b7-44b0-b1b0-54f48a2ce4cb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093438 Sep 06 21:21:29.910443 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 418/832] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:21:30.326832 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9d31a7d0-8854-4ce0-abaf-59425325c149 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:30.328037 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9d31a7d0-8854-4ce0-abaf-59425325c149 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:30.336594 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d31a7d0-8854-4ce0-abaf-59425325c149 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:30.337247 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d31a7d0-8854-4ce0-abaf-59425325c149 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:30.337914 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d31a7d0-8854-4ce0-abaf-59425325c149 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:30.338800 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d31a7d0-8854-4ce0-abaf-59425325c149 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:30.339362 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d31a7d0-8854-4ce0-abaf-59425325c149 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:30.339924 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d31a7d0-8854-4ce0-abaf-59425325c149 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:30.478363 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9d31a7d0-8854-4ce0-abaf-59425325c149 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:30.489221 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9d31a7d0-8854-4ce0-abaf-59425325c149 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:30.491229 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9d31a7d0-8854-4ce0-abaf-59425325c149 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:30.492333 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9d31a7d0-8854-4ce0-abaf-59425325c149 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1407 microversion: 2.20 time: 0.170639 Sep 06 21:21:30.493090 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 415/833] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:21:30 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:21:31.522221 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-65e34529-fbf6-4166-9b08-b9a59e89d45b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:31.522934 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-65e34529-fbf6-4166-9b08-b9a59e89d45b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:31.529467 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65e34529-fbf6-4166-9b08-b9a59e89d45b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:31.529950 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65e34529-fbf6-4166-9b08-b9a59e89d45b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:31.530388 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65e34529-fbf6-4166-9b08-b9a59e89d45b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:31.531105 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65e34529-fbf6-4166-9b08-b9a59e89d45b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:31.531556 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65e34529-fbf6-4166-9b08-b9a59e89d45b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:31.531979 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65e34529-fbf6-4166-9b08-b9a59e89d45b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:31.670310 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-65e34529-fbf6-4166-9b08-b9a59e89d45b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:31.679448 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-65e34529-fbf6-4166-9b08-b9a59e89d45b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:31.680888 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-65e34529-fbf6-4166-9b08-b9a59e89d45b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:31.681999 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-65e34529-fbf6-4166-9b08-b9a59e89d45b tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1407 microversion: 2.20 time: 0.166803 Sep 06 21:21:31.682543 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 419/834] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:21:31 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:21:32.713432 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-31640358-5c07-49fe-8585-afa54db39ed4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:32.714045 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-31640358-5c07-49fe-8585-afa54db39ed4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:32.716477 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:21:32.717257 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:21:32.722958 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31640358-5c07-49fe-8585-afa54db39ed4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:32.723431 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31640358-5c07-49fe-8585-afa54db39ed4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:32.723862 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31640358-5c07-49fe-8585-afa54db39ed4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:32.724562 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31640358-5c07-49fe-8585-afa54db39ed4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:32.725044 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31640358-5c07-49fe-8585-afa54db39ed4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:32.725454 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31640358-5c07-49fe-8585-afa54db39ed4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:32.871288 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-31640358-5c07-49fe-8585-afa54db39ed4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:32.883655 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-31640358-5c07-49fe-8585-afa54db39ed4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:32.885970 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-31640358-5c07-49fe-8585-afa54db39ed4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:32.887644 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-31640358-5c07-49fe-8585-afa54db39ed4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1599 microversion: 2.20 time: 0.178334 Sep 06 21:21:32.888374 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 416/835] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:21:32 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1599 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:21:32.915494 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ce6c5e4f-b1e8-4969-86d6-43b22c477aac tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:32.916068 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ce6c5e4f-b1e8-4969-86d6-43b22c477aac tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:32.918179 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:21:32.924327 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce6c5e4f-b1e8-4969-86d6-43b22c477aac tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:32.924906 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce6c5e4f-b1e8-4969-86d6-43b22c477aac tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:32.925338 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce6c5e4f-b1e8-4969-86d6-43b22c477aac tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:32.926036 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce6c5e4f-b1e8-4969-86d6-43b22c477aac tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:32.926485 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce6c5e4f-b1e8-4969-86d6-43b22c477aac tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:32.926903 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce6c5e4f-b1e8-4969-86d6-43b22c477aac tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:33.014726 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ce6c5e4f-b1e8-4969-86d6-43b22c477aac tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.103293 Sep 06 21:21:33.015326 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 420/836] 10.222.0.79 () {60 vars in 1316 bytes} [Tue Sep 6 21:21:32 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 21:21:34.235993 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-624361eb-5bc1-4f36-8f03-f17c0bf616de req-35bc74b6-e49f-4530-ba52-2b3cd6c4c7d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8066f708-d355-454f-b0fd-7b33e51e265e", "tag": "d805515a-5f19-4507-b89b-93b54084b935"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:21:34.246717 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-624361eb-5bc1-4f36-8f03-f17c0bf616de req-35bc74b6-e49f-4530-ba52-2b3cd6c4c7d0 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:34.247177 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-624361eb-5bc1-4f36-8f03-f17c0bf616de req-35bc74b6-e49f-4530-ba52-2b3cd6c4c7d0 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:34.247599 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-624361eb-5bc1-4f36-8f03-f17c0bf616de req-35bc74b6-e49f-4530-ba52-2b3cd6c4c7d0 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:34.259059 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-624361eb-5bc1-4f36-8f03-f17c0bf616de req-35bc74b6-e49f-4530-ba52-2b3cd6c4c7d0 service nova] Creating event network-changed:d805515a-5f19-4507-b89b-93b54084b935 for instance 8066f708-d355-454f-b0fd-7b33e51e265e on hv-cinder-74915 Sep 06 21:21:34.264103 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-624361eb-5bc1-4f36-8f03-f17c0bf616de req-35bc74b6-e49f-4530-ba52-2b3cd6c4c7d0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031879 Sep 06 21:21:34.264955 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 417/837] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:21:38.087422 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-468e3d74-2ca0-48a2-89d8-57e78e501155 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:38.088026 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-468e3d74-2ca0-48a2-89d8-57e78e501155 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:38.096468 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-468e3d74-2ca0-48a2-89d8-57e78e501155 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:38.097202 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-468e3d74-2ca0-48a2-89d8-57e78e501155 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:38.097733 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-468e3d74-2ca0-48a2-89d8-57e78e501155 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:38.098782 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-468e3d74-2ca0-48a2-89d8-57e78e501155 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:38.099429 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-468e3d74-2ca0-48a2-89d8-57e78e501155 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:38.099960 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-468e3d74-2ca0-48a2-89d8-57e78e501155 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:38.190886 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-468e3d74-2ca0-48a2-89d8-57e78e501155 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lazy-loading 'services' on Instance uuid 62f05cca-d038-4795-a189-bc7aa10064ac {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:21:38.259471 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ec27f7a2-b830-4da8-a657-fe811b2223cc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:38.260028 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ec27f7a2-b830-4da8-a657-fe811b2223cc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:38.266775 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec27f7a2-b830-4da8-a657-fe811b2223cc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:38.267266 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec27f7a2-b830-4da8-a657-fe811b2223cc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:38.267702 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec27f7a2-b830-4da8-a657-fe811b2223cc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:38.268606 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec27f7a2-b830-4da8-a657-fe811b2223cc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:38.269087 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec27f7a2-b830-4da8-a657-fe811b2223cc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:38.269341 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-468e3d74-2ca0-48a2-89d8-57e78e501155 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "DELETE /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac/os-volume_attachments/6342aa22-0c75-4882-af78-4c9347a51547" status: 202 len: 0 microversion: 2.1 time: 0.186533 Sep 06 21:21:38.269510 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec27f7a2-b830-4da8-a657-fe811b2223cc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:38.269935 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 421/838] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Sep 6 21:21:38 2022] DELETE /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac/os-volume_attachments/6342aa22-0c75-4882-af78-4c9347a51547 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:21:38.279152 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4de80543-539d-4da1-9645-d4687038cfca tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:38.281782 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4de80543-539d-4da1-9645-d4687038cfca tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:38.289388 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4de80543-539d-4da1-9645-d4687038cfca tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:38.289908 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4de80543-539d-4da1-9645-d4687038cfca tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:38.290341 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4de80543-539d-4da1-9645-d4687038cfca tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:38.291043 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4de80543-539d-4da1-9645-d4687038cfca tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:38.291528 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4de80543-539d-4da1-9645-d4687038cfca tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:38.292336 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4de80543-539d-4da1-9645-d4687038cfca tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:38.297794 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ec27f7a2-b830-4da8-a657-fe811b2223cc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 21:21:38.322663 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4de80543-539d-4da1-9645-d4687038cfca tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047842 Sep 06 21:21:38.323252 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 422/839] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:21:38 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 21:21:38.383989 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ec27f7a2-b830-4da8-a657-fe811b2223cc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 204 len: 0 microversion: 2.1 time: 0.129286 Sep 06 21:21:38.385191 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 418/840] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Sep 6 21:21:38 2022] DELETE /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 21:21:38.394175 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-43ae974b-c53d-4d85-bfc8-6a6058442f0d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:38.394792 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-43ae974b-c53d-4d85-bfc8-6a6058442f0d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:38.401254 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43ae974b-c53d-4d85-bfc8-6a6058442f0d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:38.401739 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43ae974b-c53d-4d85-bfc8-6a6058442f0d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:38.402174 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43ae974b-c53d-4d85-bfc8-6a6058442f0d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:38.402876 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43ae974b-c53d-4d85-bfc8-6a6058442f0d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:38.403332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43ae974b-c53d-4d85-bfc8-6a6058442f0d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:38.403752 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43ae974b-c53d-4d85-bfc8-6a6058442f0d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:38.539075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-43ae974b-c53d-4d85-bfc8-6a6058442f0d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:38.547036 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-43ae974b-c53d-4d85-bfc8-6a6058442f0d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1576 microversion: 2.1 time: 0.157094 Sep 06 21:21:38.547966 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 423/841] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:38 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:39.336810 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-db1ab6f6-3aec-41be-a352-fe6790eb9e98 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:39.339096 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-db1ab6f6-3aec-41be-a352-fe6790eb9e98 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:39.346117 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db1ab6f6-3aec-41be-a352-fe6790eb9e98 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:39.346605 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db1ab6f6-3aec-41be-a352-fe6790eb9e98 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:39.347041 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db1ab6f6-3aec-41be-a352-fe6790eb9e98 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:39.347741 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db1ab6f6-3aec-41be-a352-fe6790eb9e98 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:39.348195 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db1ab6f6-3aec-41be-a352-fe6790eb9e98 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:39.348617 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db1ab6f6-3aec-41be-a352-fe6790eb9e98 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:39.378968 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-db1ab6f6-3aec-41be-a352-fe6790eb9e98 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046662 Sep 06 21:21:39.379518 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 419/842] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:21:39 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:21:39.574085 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-60f881b9-8318-4cad-9036-79ce07a0db00 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:39.574704 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-60f881b9-8318-4cad-9036-79ce07a0db00 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:39.583527 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60f881b9-8318-4cad-9036-79ce07a0db00 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:39.584011 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60f881b9-8318-4cad-9036-79ce07a0db00 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:39.584434 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60f881b9-8318-4cad-9036-79ce07a0db00 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:39.585168 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60f881b9-8318-4cad-9036-79ce07a0db00 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:39.585610 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60f881b9-8318-4cad-9036-79ce07a0db00 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:39.586028 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60f881b9-8318-4cad-9036-79ce07a0db00 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:39.721057 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-60f881b9-8318-4cad-9036-79ce07a0db00 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:39.728994 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-60f881b9-8318-4cad-9036-79ce07a0db00 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1576 microversion: 2.1 time: 0.161394 Sep 06 21:21:39.729556 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 424/843] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:39 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:40.391998 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-39ec8127-067c-465e-b26c-25c4d814283c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:40.394226 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-39ec8127-067c-465e-b26c-25c4d814283c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:40.401361 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39ec8127-067c-465e-b26c-25c4d814283c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:40.401845 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39ec8127-067c-465e-b26c-25c4d814283c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:40.402278 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39ec8127-067c-465e-b26c-25c4d814283c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:40.402975 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39ec8127-067c-465e-b26c-25c4d814283c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:40.403427 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39ec8127-067c-465e-b26c-25c4d814283c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:40.403825 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39ec8127-067c-465e-b26c-25c4d814283c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:40.434469 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-39ec8127-067c-465e-b26c-25c4d814283c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046630 Sep 06 21:21:40.435032 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 420/844] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:21:40 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:21:40.753635 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eba80d88-2d0b-4ebc-adee-b659e5d08fbd tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:40.754920 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-eba80d88-2d0b-4ebc-adee-b659e5d08fbd tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:40.762364 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eba80d88-2d0b-4ebc-adee-b659e5d08fbd tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:40.762855 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eba80d88-2d0b-4ebc-adee-b659e5d08fbd tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:40.763287 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eba80d88-2d0b-4ebc-adee-b659e5d08fbd tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:40.763997 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eba80d88-2d0b-4ebc-adee-b659e5d08fbd tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:40.764447 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eba80d88-2d0b-4ebc-adee-b659e5d08fbd tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:40.764950 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eba80d88-2d0b-4ebc-adee-b659e5d08fbd tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:40.902672 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-eba80d88-2d0b-4ebc-adee-b659e5d08fbd tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:40.910959 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-eba80d88-2d0b-4ebc-adee-b659e5d08fbd tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1576 microversion: 2.1 time: 0.161299 Sep 06 21:21:40.911566 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 425/845] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:40 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:41.447659 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c1d26ba7-48d5-474b-a6f8-69b0aa07c969 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:41.449947 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c1d26ba7-48d5-474b-a6f8-69b0aa07c969 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:41.456812 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1d26ba7-48d5-474b-a6f8-69b0aa07c969 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:41.457299 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1d26ba7-48d5-474b-a6f8-69b0aa07c969 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:41.457732 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1d26ba7-48d5-474b-a6f8-69b0aa07c969 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:41.458434 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1d26ba7-48d5-474b-a6f8-69b0aa07c969 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:41.458882 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1d26ba7-48d5-474b-a6f8-69b0aa07c969 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:41.459300 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1d26ba7-48d5-474b-a6f8-69b0aa07c969 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:41.492063 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c1d26ba7-48d5-474b-a6f8-69b0aa07c969 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048739 Sep 06 21:21:41.492628 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 421/846] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:21:41 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 21:21:41.575469 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-25d0b0c3-abf0-4c8b-8ead-a031501a3c70 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:41.576019 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-25d0b0c3-abf0-4c8b-8ead-a031501a3c70 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:41.582550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25d0b0c3-abf0-4c8b-8ead-a031501a3c70 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:41.583119 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25d0b0c3-abf0-4c8b-8ead-a031501a3c70 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:41.583582 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25d0b0c3-abf0-4c8b-8ead-a031501a3c70 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:41.584301 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25d0b0c3-abf0-4c8b-8ead-a031501a3c70 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:41.584778 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25d0b0c3-abf0-4c8b-8ead-a031501a3c70 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:41.585201 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25d0b0c3-abf0-4c8b-8ead-a031501a3c70 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:41.614490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-25d0b0c3-abf0-4c8b-8ead-a031501a3c70 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 21:21:41.702801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-25d0b0c3-abf0-4c8b-8ead-a031501a3c70 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "DELETE /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 204 len: 0 microversion: 2.1 time: 0.131090 Sep 06 21:21:41.703842 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 426/847] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Sep 6 21:21:41 2022] DELETE /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 21:21:41.713675 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9592885c-9bee-4ae4-ab6a-c3d1944b6a6c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:41.714715 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9592885c-9bee-4ae4-ab6a-c3d1944b6a6c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:41.721653 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9592885c-9bee-4ae4-ab6a-c3d1944b6a6c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:41.722741 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9592885c-9bee-4ae4-ab6a-c3d1944b6a6c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:41.723384 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9592885c-9bee-4ae4-ab6a-c3d1944b6a6c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:41.724488 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9592885c-9bee-4ae4-ab6a-c3d1944b6a6c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:41.725233 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9592885c-9bee-4ae4-ab6a-c3d1944b6a6c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:41.725854 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9592885c-9bee-4ae4-ab6a-c3d1944b6a6c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:41.808459 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-d89153e2-07a9-4a5a-b15c-21fbb39dffa4 req-e2a89943-2711-4024-8e1b-5174760c1c1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8d6fc21-502d-41ec-8216-29ad57153010", "name": "network-vif-deleted", "tag": "8d3992ee-ded1-4b3c-8436-fe6805e12ddd"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:21:41.826895 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-d89153e2-07a9-4a5a-b15c-21fbb39dffa4 req-e2a89943-2711-4024-8e1b-5174760c1c1b service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:41.827679 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-d89153e2-07a9-4a5a-b15c-21fbb39dffa4 req-e2a89943-2711-4024-8e1b-5174760c1c1b service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:41.828157 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-d89153e2-07a9-4a5a-b15c-21fbb39dffa4 req-e2a89943-2711-4024-8e1b-5174760c1c1b service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:41.841289 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-d89153e2-07a9-4a5a-b15c-21fbb39dffa4 req-e2a89943-2711-4024-8e1b-5174760c1c1b service nova] Creating event network-vif-deleted:8d3992ee-ded1-4b3c-8436-fe6805e12ddd for instance a8d6fc21-502d-41ec-8216-29ad57153010 on hv-cinder-74915 Sep 06 21:21:41.846677 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-d89153e2-07a9-4a5a-b15c-21fbb39dffa4 req-e2a89943-2711-4024-8e1b-5174760c1c1b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057256 Sep 06 21:21:41.847912 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 427/848] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:21:41.899557 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9592885c-9bee-4ae4-ab6a-c3d1944b6a6c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:41.907764 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9592885c-9bee-4ae4-ab6a-c3d1944b6a6c tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1688 microversion: 2.1 time: 0.199526 Sep 06 21:21:41.908758 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 422/849] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:41 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1688 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:41.935513 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-078017e4-119f-4ce6-b5d7-c3921d077f8c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:41.936317 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-078017e4-119f-4ce6-b5d7-c3921d077f8c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:41.943239 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-078017e4-119f-4ce6-b5d7-c3921d077f8c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:41.943803 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-078017e4-119f-4ce6-b5d7-c3921d077f8c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:41.944624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-078017e4-119f-4ce6-b5d7-c3921d077f8c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:41.945485 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-078017e4-119f-4ce6-b5d7-c3921d077f8c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:41.946050 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-078017e4-119f-4ce6-b5d7-c3921d077f8c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:41.946842 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-078017e4-119f-4ce6-b5d7-c3921d077f8c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:42.031390 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-078017e4-119f-4ce6-b5d7-c3921d077f8c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:42.039693 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-078017e4-119f-4ce6-b5d7-c3921d077f8c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1509 microversion: 2.1 time: 0.108154 Sep 06 21:21:42.040248 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 428/850] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:41 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1509 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:42.936304 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1a642e54-a364-4f0e-882e-396329c83791 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:42.937303 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1a642e54-a364-4f0e-882e-396329c83791 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:42.947538 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a642e54-a364-4f0e-882e-396329c83791 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:42.947979 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a642e54-a364-4f0e-882e-396329c83791 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:42.948544 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a642e54-a364-4f0e-882e-396329c83791 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:42.949295 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a642e54-a364-4f0e-882e-396329c83791 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:42.949742 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a642e54-a364-4f0e-882e-396329c83791 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:42.950182 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a642e54-a364-4f0e-882e-396329c83791 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:43.065328 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0dc8b524-644d-4b5c-bc31-4525fa65c1db tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:43.066923 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0dc8b524-644d-4b5c-bc31-4525fa65c1db tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:43.075684 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0dc8b524-644d-4b5c-bc31-4525fa65c1db tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:43.076200 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0dc8b524-644d-4b5c-bc31-4525fa65c1db tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:43.076673 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0dc8b524-644d-4b5c-bc31-4525fa65c1db tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:43.077380 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0dc8b524-644d-4b5c-bc31-4525fa65c1db tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:43.078195 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0dc8b524-644d-4b5c-bc31-4525fa65c1db tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:43.078195 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0dc8b524-644d-4b5c-bc31-4525fa65c1db tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:43.093562 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:21:43.095155 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1a642e54-a364-4f0e-882e-396329c83791 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:43.103564 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1a642e54-a364-4f0e-882e-396329c83791 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1688 microversion: 2.1 time: 0.173691 Sep 06 21:21:43.104150 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 423/851] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:42 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:43.143130 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0dc8b524-644d-4b5c-bc31-4525fa65c1db tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:43.152111 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0dc8b524-644d-4b5c-bc31-4525fa65c1db tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1509 microversion: 2.1 time: 0.092255 Sep 06 21:21:43.152666 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 429/852] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:43 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1509 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:44.130348 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0f71c03e-f302-4c49-896d-41414c3a84bc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:44.131466 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0f71c03e-f302-4c49-896d-41414c3a84bc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:44.143157 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f71c03e-f302-4c49-896d-41414c3a84bc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:44.143959 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f71c03e-f302-4c49-896d-41414c3a84bc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:44.144697 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f71c03e-f302-4c49-896d-41414c3a84bc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:44.145897 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f71c03e-f302-4c49-896d-41414c3a84bc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:44.146650 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f71c03e-f302-4c49-896d-41414c3a84bc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:44.147355 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f71c03e-f302-4c49-896d-41414c3a84bc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:44.175964 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6ce86429-07c6-4466-84d3-62e88d79742a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:44.176568 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6ce86429-07c6-4466-84d3-62e88d79742a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:44.183231 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ce86429-07c6-4466-84d3-62e88d79742a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:44.183714 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ce86429-07c6-4466-84d3-62e88d79742a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:44.184170 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ce86429-07c6-4466-84d3-62e88d79742a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:44.184884 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ce86429-07c6-4466-84d3-62e88d79742a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:44.185332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ce86429-07c6-4466-84d3-62e88d79742a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:44.185757 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ce86429-07c6-4466-84d3-62e88d79742a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:44.249785 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6ce86429-07c6-4466-84d3-62e88d79742a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:44.257597 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6ce86429-07c6-4466-84d3-62e88d79742a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1509 microversion: 2.1 time: 0.085896 Sep 06 21:21:44.258149 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 430/853] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:44 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1509 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:44.283015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0f71c03e-f302-4c49-896d-41414c3a84bc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:44.291111 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0f71c03e-f302-4c49-896d-41414c3a84bc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1688 microversion: 2.1 time: 0.167283 Sep 06 21:21:44.291678 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 424/854] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:44 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:45.281653 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b78307c3-8a02-4682-9f41-3d956fe93a64 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:45.282320 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b78307c3-8a02-4682-9f41-3d956fe93a64 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:45.289115 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b78307c3-8a02-4682-9f41-3d956fe93a64 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:45.289589 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b78307c3-8a02-4682-9f41-3d956fe93a64 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:45.290015 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b78307c3-8a02-4682-9f41-3d956fe93a64 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:45.290815 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b78307c3-8a02-4682-9f41-3d956fe93a64 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:45.291261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b78307c3-8a02-4682-9f41-3d956fe93a64 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:45.291698 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b78307c3-8a02-4682-9f41-3d956fe93a64 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:45.314643 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-932f8ea5-ed10-4cc5-969f-53d2e41db3b6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:45.315498 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-932f8ea5-ed10-4cc5-969f-53d2e41db3b6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:45.321901 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-932f8ea5-ed10-4cc5-969f-53d2e41db3b6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:45.322408 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-932f8ea5-ed10-4cc5-969f-53d2e41db3b6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:45.322864 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-932f8ea5-ed10-4cc5-969f-53d2e41db3b6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:45.323571 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-932f8ea5-ed10-4cc5-969f-53d2e41db3b6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:45.324024 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-932f8ea5-ed10-4cc5-969f-53d2e41db3b6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:45.324450 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-932f8ea5-ed10-4cc5-969f-53d2e41db3b6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:45.354862 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b78307c3-8a02-4682-9f41-3d956fe93a64 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:45.363169 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b78307c3-8a02-4682-9f41-3d956fe93a64 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1225 microversion: 2.1 time: 0.085530 Sep 06 21:21:45.363752 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 431/855] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:45 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:45.455278 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-932f8ea5-ed10-4cc5-969f-53d2e41db3b6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:45.463903 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-932f8ea5-ed10-4cc5-969f-53d2e41db3b6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1688 microversion: 2.1 time: 0.153120 Sep 06 21:21:45.464525 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 425/856] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:45 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:46.387016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c3b1f17c-216c-406c-8f55-5718854a7793 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:46.387785 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c3b1f17c-216c-406c-8f55-5718854a7793 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:46.395027 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3b1f17c-216c-406c-8f55-5718854a7793 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:46.395653 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3b1f17c-216c-406c-8f55-5718854a7793 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:46.396096 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3b1f17c-216c-406c-8f55-5718854a7793 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:46.397703 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3b1f17c-216c-406c-8f55-5718854a7793 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:46.398164 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3b1f17c-216c-406c-8f55-5718854a7793 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:46.398591 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3b1f17c-216c-406c-8f55-5718854a7793 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:46.438332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3b1f17c-216c-406c-8f55-5718854a7793 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:46.438821 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3b1f17c-216c-406c-8f55-5718854a7793 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:46.439252 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3b1f17c-216c-406c-8f55-5718854a7793 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:46.439705 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-c3b1f17c-216c-406c-8f55-5718854a7793 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lazy-loading 'fault' on Instance uuid a8d6fc21-502d-41ec-8216-29ad57153010 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:21:46.489076 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1b5f2550-5141-4692-b8e8-e64ce475aa21 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:46.490296 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1b5f2550-5141-4692-b8e8-e64ce475aa21 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:46.490550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c3b1f17c-216c-406c-8f55-5718854a7793 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:46.497774 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b5f2550-5141-4692-b8e8-e64ce475aa21 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:46.499512 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c3b1f17c-216c-406c-8f55-5718854a7793 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 200 len: 1230 microversion: 2.1 time: 0.116499 Sep 06 21:21:46.500096 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b5f2550-5141-4692-b8e8-e64ce475aa21 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:46.500422 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 432/857] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:46 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 1230 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:46.500975 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b5f2550-5141-4692-b8e8-e64ce475aa21 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:46.502008 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b5f2550-5141-4692-b8e8-e64ce475aa21 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:46.502638 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b5f2550-5141-4692-b8e8-e64ce475aa21 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:46.503060 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b5f2550-5141-4692-b8e8-e64ce475aa21 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:46.527781 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:21:46.580353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1b5f2550-5141-4692-b8e8-e64ce475aa21 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:46.593624 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1b5f2550-5141-4692-b8e8-e64ce475aa21 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 200 len: 1621 microversion: 2.1 time: 0.109194 Sep 06 21:21:46.594365 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 426/858] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:46 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 1621 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:21:46.756820 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-4db9939e-72d2-4a1e-89c8-d0a56aa806f4 req-f55c96f5-632a-4b27-9f94-7a57d1acdeb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f05cca-d038-4795-a189-bc7aa10064ac", "name": "network-vif-deleted", "tag": "6ae70e6c-1486-49e9-ba26-6e0a2ae18f0e"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:21:46.766863 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4db9939e-72d2-4a1e-89c8-d0a56aa806f4 req-f55c96f5-632a-4b27-9f94-7a57d1acdeb9 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:46.767337 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4db9939e-72d2-4a1e-89c8-d0a56aa806f4 req-f55c96f5-632a-4b27-9f94-7a57d1acdeb9 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:46.767759 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4db9939e-72d2-4a1e-89c8-d0a56aa806f4 req-f55c96f5-632a-4b27-9f94-7a57d1acdeb9 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:46.780189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-4db9939e-72d2-4a1e-89c8-d0a56aa806f4 req-f55c96f5-632a-4b27-9f94-7a57d1acdeb9 service nova] Creating event network-vif-deleted:6ae70e6c-1486-49e9-ba26-6e0a2ae18f0e for instance 62f05cca-d038-4795-a189-bc7aa10064ac on hv-cinder-74915 Sep 06 21:21:46.785199 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-4db9939e-72d2-4a1e-89c8-d0a56aa806f4 req-f55c96f5-632a-4b27-9f94-7a57d1acdeb9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032069 Sep 06 21:21:46.785782 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 433/859] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:21:47.523607 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9ca97a40-57b4-4c2a-a594-ce2ab4e6eba8 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:47.524147 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9ca97a40-57b4-4c2a-a594-ce2ab4e6eba8 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:47.530690 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ca97a40-57b4-4c2a-a594-ce2ab4e6eba8 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:47.531208 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ca97a40-57b4-4c2a-a594-ce2ab4e6eba8 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:47.531609 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ca97a40-57b4-4c2a-a594-ce2ab4e6eba8 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:47.532312 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ca97a40-57b4-4c2a-a594-ce2ab4e6eba8 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:47.532803 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ca97a40-57b4-4c2a-a594-ce2ab4e6eba8 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:47.533211 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ca97a40-57b4-4c2a-a594-ce2ab4e6eba8 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:47.548196 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-9ca97a40-57b4-4c2a-a594-ce2ab4e6eba8 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] HTTP exception thrown: Instance a8d6fc21-502d-41ec-8216-29ad57153010 could not be found. Sep 06 21:21:47.550214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9ca97a40-57b4-4c2a-a594-ce2ab4e6eba8 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Request method failure captured: Sep 06 21:21:47.550214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 HTTP/1.1 Sep 06 21:21:47.550214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 06 21:21:47.550214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 06 21:21:47.550214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Connection: close Sep 06 21:21:47.550214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 06 21:21:47.550214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 06 21:21:47.550214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Host: 10.222.0.79 Sep 06 21:21:47.550214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 06 21:21:47.550214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 06 21:21:47.550214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjF7jQwuYbSnhwsURE38g_NHxq8bkKeKTGiasuG8R4J_ohgqXTkmcNemP-pvRgIf7MR28ChWbVjrUwIwrlbvTaNHxgEiRZjVhDAuiU5kjaT_8n44UF6j6b14JfeGTZ8SassSWNa8C9Bt9GxMa4yojoeSluWQiZXZE308nZw0eafQVQ1xg Sep 06 21:21:47.550214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 06 21:21:47.550214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 06 21:21:47.550214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 06 21:21:47.550214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 06 21:21:47.550214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 06 21:21:47.550214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 06 21:21:47.550214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Id: 5801984f41a043daa52dbef9de89df9a Sep 06 21:21:47.550214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-TestVolumeBootPattern-1838133913 Sep 06 21:21:47.550214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Role: reader,member Sep 06 21:21:47.550214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Sep 06 21:21:47.551790 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5801984f41a043daa52dbef9de89df9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5801984f41a043daa52dbef9de89df9a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5801984f41a043daa52dbef9de89df9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5801984f41a043daa52dbef9de89df9a"}]}] Sep 06 21:21:47.551790 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-TestVolumeBootPattern-1838133913 Sep 06 21:21:47.551790 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 5801984f41a043daa52dbef9de89df9a Sep 06 21:21:47.551790 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestVolumeBootPattern-1838133913 Sep 06 21:21:47.551790 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User: tempest-TestVolumeBootPattern-1838133913-project Sep 06 21:21:47.551790 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 06 21:21:47.551790 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 06 21:21:47.551790 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Id: 6d0c1c510b0a4fa39927f7f92352d034 Sep 06 21:21:47.551790 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-TestVolumeBootPattern-1838133913-project Sep 06 21:21:47.551790 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: method: > Sep 06 21:21:47.551790 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: exception: Instance a8d6fc21-502d-41ec-8216-29ad57153010 could not be found. Sep 06 21:21:47.551790 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: action_args: {'id': 'a8d6fc21-502d-41ec-8216-29ad57153010'} Sep 06 21:21:47.552698 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:21:47.552698 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:21:47.552698 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:21:47.552698 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:21:47.552698 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:21:47.552698 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:21:47.552698 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:21:47.552698 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:21:47.552698 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:21:47.552698 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:21:47.552698 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8d6fc21-502d-41ec-8216-29ad57153010 could not be found. Sep 06 21:21:47.552698 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:21:47.552698 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:21:47.552698 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:21:47.552698 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:21:47.552698 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:21:47.552698 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:21:47.552698 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:21:47.552698 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:21:47.552698 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:21:47.554106 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:21:47.554106 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:21:47.554106 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:21:47.554106 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:21:47.554106 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:21:47.554106 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:21:47.554106 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:21:47.554106 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8d6fc21-502d-41ec-8216-29ad57153010 could not be found. Sep 06 21:21:47.554106 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:21:47.554106 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:21:47.554106 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:21:47.554106 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:21:47.554106 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:21:47.554106 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:21:47.554106 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:21:47.554106 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:21:47.554106 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8d6fc21-502d-41ec-8216-29ad57153010 could not be found. Sep 06 21:21:47.554106 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:21:47.555985 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9ca97a40-57b4-4c2a-a594-ce2ab4e6eba8 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Returning 404 to user: Instance a8d6fc21-502d-41ec-8216-29ad57153010 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:21:47.557027 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9ca97a40-57b4-4c2a-a594-ce2ab4e6eba8 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 404 len: 111 microversion: 2.1 time: 0.037428 Sep 06 21:21:47.557780 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 427/860] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:47 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:21:47.617518 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-67a6f090-cd17-40f5-b53e-d389cee22c07 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:47.618216 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-67a6f090-cd17-40f5-b53e-d389cee22c07 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: 62f05cca-d038-4795-a189-bc7aa10064ac] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:47.632974 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67a6f090-cd17-40f5-b53e-d389cee22c07 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:47.633694 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67a6f090-cd17-40f5-b53e-d389cee22c07 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:47.634163 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67a6f090-cd17-40f5-b53e-d389cee22c07 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:47.634897 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67a6f090-cd17-40f5-b53e-d389cee22c07 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:47.635349 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67a6f090-cd17-40f5-b53e-d389cee22c07 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:47.635768 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67a6f090-cd17-40f5-b53e-d389cee22c07 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:47.651015 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-67a6f090-cd17-40f5-b53e-d389cee22c07 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] HTTP exception thrown: Instance 62f05cca-d038-4795-a189-bc7aa10064ac could not be found. Sep 06 21:21:47.653154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-67a6f090-cd17-40f5-b53e-d389cee22c07 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Request method failure captured: Sep 06 21:21:47.653154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac HTTP/1.1 Sep 06 21:21:47.653154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:21:47.653154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:21:47.653154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:21:47.653154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:21:47.653154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:21:47.653154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:21:47.653154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:21:47.653154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:21:47.653154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7gUN_FLSnpNG9HSuch7Adumi07PvDapiWYlb4hdEBJJ-3oDVKZT8eH0XUiQphynu_EAk0GMMbuGt07jVLp2XHuc-gGocBp-HoFX8pN_ZBw-uxiJnYglnmqkenrCvYYKoQN5M4O4ySALb1G6TjikmxU7GQJcI9jL4bBNWv5FzOObxk8 Sep 06 21:21:47.653154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:21:47.653154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:21:47.653154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:21:47.653154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:21:47.653154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:21:47.653154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:21:47.653154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: ff397d6b3f4a42bf8b68b3bc55600dba Sep 06 21:21:47.653154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-456052109 Sep 06 21:21:47.653154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:21:47.653154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:21:47.654720 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ff397d6b3f4a42bf8b68b3bc55600dba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ff397d6b3f4a42bf8b68b3bc55600dba", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ff397d6b3f4a42bf8b68b3bc55600dba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ff397d6b3f4a42bf8b68b3bc55600dba"}]}] Sep 06 21:21:47.654720 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-ServerRescueNegativeTestJSON-456052109 Sep 06 21:21:47.654720 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: ff397d6b3f4a42bf8b68b3bc55600dba Sep 06 21:21:47.654720 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-456052109 Sep 06 21:21:47.654720 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-ServerRescueNegativeTestJSON-456052109-project Sep 06 21:21:47.654720 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:21:47.654720 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:21:47.654720 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: 2ec47d6e2e9b40a6bd207c084041f7a9 Sep 06 21:21:47.654720 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-ServerRescueNegativeTestJSON-456052109-project Sep 06 21:21:47.654720 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: > Sep 06 21:21:47.654720 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Instance 62f05cca-d038-4795-a189-bc7aa10064ac could not be found. Sep 06 21:21:47.654720 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'id': '62f05cca-d038-4795-a189-bc7aa10064ac'} Sep 06 21:21:47.655624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:21:47.655624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:21:47.655624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:21:47.655624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:21:47.655624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:21:47.655624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:21:47.655624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:21:47.655624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:21:47.655624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:21:47.655624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:21:47.655624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62f05cca-d038-4795-a189-bc7aa10064ac could not be found. Sep 06 21:21:47.655624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:21:47.655624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:21:47.655624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:21:47.655624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:21:47.655624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:21:47.655624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:21:47.655624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:21:47.655624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:21:47.655624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:21:47.657053 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:21:47.657053 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:21:47.657053 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:21:47.657053 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:21:47.657053 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:21:47.657053 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:21:47.657053 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:21:47.657053 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62f05cca-d038-4795-a189-bc7aa10064ac could not be found. Sep 06 21:21:47.657053 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:21:47.657053 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:21:47.657053 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:21:47.657053 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:21:47.657053 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:21:47.657053 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:21:47.657053 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:21:47.657053 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:21:47.657053 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62f05cca-d038-4795-a189-bc7aa10064ac could not be found. Sep 06 21:21:47.657053 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:21:47.659322 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-67a6f090-cd17-40f5-b53e-d389cee22c07 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Returning 404 to user: Instance 62f05cca-d038-4795-a189-bc7aa10064ac could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:21:47.660393 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-67a6f090-cd17-40f5-b53e-d389cee22c07 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac" status: 404 len: 111 microversion: 2.1 time: 0.047189 Sep 06 21:21:47.660991 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 434/861] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:47 2022] GET /compute/v2.1/servers/62f05cca-d038-4795-a189-bc7aa10064ac => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:21:47.669553 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-75485967-8c9f-4f55-8522-b8541dc782bc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '.version_select at 0x7f04ce447a60>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:47.692620 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-75485967-8c9f-4f55-8522-b8541dc782bc tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-907304961" status: 202 len: 0 microversion: 2.1 time: 0.026812 Sep 06 21:21:47.693189 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 428/862] 10.222.0.79 () {58 vars in 1218 bytes} [Tue Sep 6 21:21:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-907304961 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:21:47.717727 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-67fa44d0-d369-4503-8461-de80323f2a43 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1038261618", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1275668507", "security_groups": [{"name": "tempest-secgroup-smoke-925187046"}], "block_device_mapping_v2": [{"uuid": "9e877a0f-7052-4a60-9489-ff565d3d09c0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a5bbf437-763d-4024-8517-0795a424e454"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:21:47.884462 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-67fa44d0-d369-4503-8461-de80323f2a43 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] validate_networks() for [('a5bbf437-763d-4024-8517-0795a424e454', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 21:21:48.340453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-67fa44d0-d369-4503-8461-de80323f2a43 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 21:21:48.341063 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-67fa44d0-d369-4503-8461-de80323f2a43 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 21:21:48.341617 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-67fa44d0-d369-4503-8461-de80323f2a43 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 21:21:48.342097 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-67fa44d0-d369-4503-8461-de80323f2a43 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 21:21:48.342597 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-67fa44d0-d369-4503-8461-de80323f2a43 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 21:21:48.353018 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67fa44d0-d369-4503-8461-de80323f2a43 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:48.353018 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67fa44d0-d369-4503-8461-de80323f2a43 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:48.353558 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67fa44d0-d369-4503-8461-de80323f2a43 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:48.354378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67fa44d0-d369-4503-8461-de80323f2a43 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:48.354908 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67fa44d0-d369-4503-8461-de80323f2a43 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:48.355369 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67fa44d0-d369-4503-8461-de80323f2a43 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:48.374027 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-67fa44d0-d369-4503-8461-de80323f2a43 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Getting quotas for project 5801984f41a043daa52dbef9de89df9a. Resources: {'ram', 'cores', 'instances'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:21:48.378136 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-67fa44d0-d369-4503-8461-de80323f2a43 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Getting quotas for user 6d0c1c510b0a4fa39927f7f92352d034 and project 5801984f41a043daa52dbef9de89df9a. Resources: {'ram', 'cores', 'instances'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:21:48.437724 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-67fa44d0-d369-4503-8461-de80323f2a43 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 21:21:48.440046 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-67fa44d0-d369-4503-8461-de80323f2a43 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9e877a0f-7052-4a60-9489-ff565d3d09c0',volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 21:21:48.582527 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-67fa44d0-d369-4503-8461-de80323f2a43 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.868998 Sep 06 21:21:48.583346 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 435/863] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Sep 6 21:21:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 21:21:48.596674 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2640dee0-1a94-4265-a8d2-f3a55f337741 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:48.597457 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2640dee0-1a94-4265-a8d2-f3a55f337741 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:48.657761 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2640dee0-1a94-4265-a8d2-f3a55f337741 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:48.665932 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2640dee0-1a94-4265-a8d2-f3a55f337741 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 200 len: 1095 microversion: 2.1 time: 0.073908 Sep 06 21:21:48.666698 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 429/864] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:48 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:48.671570 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c4882a7e-22a5-48ca-96e9-ec0d1d460a6e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:21:48.672267 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c4882a7e-22a5-48ca-96e9-ec0d1d460a6e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:48.674831 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:21:48.681460 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4882a7e-22a5-48ca-96e9-ec0d1d460a6e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:48.682108 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4882a7e-22a5-48ca-96e9-ec0d1d460a6e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:48.682640 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4882a7e-22a5-48ca-96e9-ec0d1d460a6e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:48.683719 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4882a7e-22a5-48ca-96e9-ec0d1d460a6e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:48.684021 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4882a7e-22a5-48ca-96e9-ec0d1d460a6e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:48.684536 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c4882a7e-22a5-48ca-96e9-ec0d1d460a6e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:48.708978 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-c4882a7e-22a5-48ca-96e9-ec0d1d460a6e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lazy-loading 'flavor' on Instance uuid 340de6d7-883f-4c26-89b1-4f8536aa09e8 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:21:48.784843 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c4882a7e-22a5-48ca-96e9-ec0d1d460a6e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "POST /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8/action" status: 202 len: 0 microversion: 2.1 time: 0.118255 Sep 06 21:21:48.785543 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 436/865] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Sep 6 21:21:48 2022] POST /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 21:21:48.795103 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d68ecdd9-69b9-43b0-8cad-0a8a317f316e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:48.795721 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d68ecdd9-69b9-43b0-8cad-0a8a317f316e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:48.804891 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d68ecdd9-69b9-43b0-8cad-0a8a317f316e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:48.805393 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d68ecdd9-69b9-43b0-8cad-0a8a317f316e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:48.806202 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d68ecdd9-69b9-43b0-8cad-0a8a317f316e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:48.807190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d68ecdd9-69b9-43b0-8cad-0a8a317f316e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:48.807695 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d68ecdd9-69b9-43b0-8cad-0a8a317f316e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:48.808140 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d68ecdd9-69b9-43b0-8cad-0a8a317f316e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:48.948012 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d68ecdd9-69b9-43b0-8cad-0a8a317f316e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:48.957065 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d68ecdd9-69b9-43b0-8cad-0a8a317f316e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1566 microversion: 2.1 time: 0.166805 Sep 06 21:21:48.957993 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 430/866] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:48 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:49.692131 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-246a1d88-f544-48f6-a594-f15d4858488b tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:49.692868 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-246a1d88-f544-48f6-a594-f15d4858488b tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:49.699965 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-246a1d88-f544-48f6-a594-f15d4858488b tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:49.700453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-246a1d88-f544-48f6-a594-f15d4858488b tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:49.700923 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-246a1d88-f544-48f6-a594-f15d4858488b tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:49.701634 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-246a1d88-f544-48f6-a594-f15d4858488b tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:49.702086 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-246a1d88-f544-48f6-a594-f15d4858488b tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:49.702512 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-246a1d88-f544-48f6-a594-f15d4858488b tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:49.779493 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-246a1d88-f544-48f6-a594-f15d4858488b tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:49.787697 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-246a1d88-f544-48f6-a594-f15d4858488b tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 200 len: 1193 microversion: 2.1 time: 0.100468 Sep 06 21:21:49.788309 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 437/867] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:49 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 1193 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:49.982099 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7c730d64-4732-42c5-b63d-9fdb89a397e1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:49.983367 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7c730d64-4732-42c5-b63d-9fdb89a397e1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:49.990924 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c730d64-4732-42c5-b63d-9fdb89a397e1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:49.991670 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c730d64-4732-42c5-b63d-9fdb89a397e1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:49.992611 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c730d64-4732-42c5-b63d-9fdb89a397e1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:49.993196 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c730d64-4732-42c5-b63d-9fdb89a397e1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:49.993810 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c730d64-4732-42c5-b63d-9fdb89a397e1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:49.994395 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c730d64-4732-42c5-b63d-9fdb89a397e1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:50.168897 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7c730d64-4732-42c5-b63d-9fdb89a397e1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:50.177885 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7c730d64-4732-42c5-b63d-9fdb89a397e1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1566 microversion: 2.1 time: 0.200015 Sep 06 21:21:50.178984 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 431/868] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:49 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1566 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:50.721820 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2f1d604d-9a5c-4aa7-93c9-ebc347b519a6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:50.722354 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2f1d604d-9a5c-4aa7-93c9-ebc347b519a6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:50.729489 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f1d604d-9a5c-4aa7-93c9-ebc347b519a6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:50.730036 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f1d604d-9a5c-4aa7-93c9-ebc347b519a6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:50.730448 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f1d604d-9a5c-4aa7-93c9-ebc347b519a6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:50.731255 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f1d604d-9a5c-4aa7-93c9-ebc347b519a6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:50.731695 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f1d604d-9a5c-4aa7-93c9-ebc347b519a6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:50.732158 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f1d604d-9a5c-4aa7-93c9-ebc347b519a6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:50.764687 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2f1d604d-9a5c-4aa7-93c9-ebc347b519a6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 21:21:50.811508 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-21c95267-9bf7-48a3-8bbb-0b983b798532 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:50.812332 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-21c95267-9bf7-48a3-8bbb-0b983b798532 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:50.818574 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21c95267-9bf7-48a3-8bbb-0b983b798532 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:50.819282 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21c95267-9bf7-48a3-8bbb-0b983b798532 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:50.819904 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21c95267-9bf7-48a3-8bbb-0b983b798532 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:50.820616 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21c95267-9bf7-48a3-8bbb-0b983b798532 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:50.821190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21c95267-9bf7-48a3-8bbb-0b983b798532 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:50.821609 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21c95267-9bf7-48a3-8bbb-0b983b798532 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:50.888800 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2f1d604d-9a5c-4aa7-93c9-ebc347b519a6 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 204 len: 0 microversion: 2.1 time: 0.170682 Sep 06 21:21:50.889888 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 438/869] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Sep 6 21:21:50 2022] DELETE /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 21:21:50.901495 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-000960b5-c357-4d05-a32e-cce9688e593a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:50.902625 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-000960b5-c357-4d05-a32e-cce9688e593a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:50.910109 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-000960b5-c357-4d05-a32e-cce9688e593a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:50.911492 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-000960b5-c357-4d05-a32e-cce9688e593a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:50.912273 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-000960b5-c357-4d05-a32e-cce9688e593a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:50.913355 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-000960b5-c357-4d05-a32e-cce9688e593a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:50.913976 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-000960b5-c357-4d05-a32e-cce9688e593a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:50.914723 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-000960b5-c357-4d05-a32e-cce9688e593a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:51.067385 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-000960b5-c357-4d05-a32e-cce9688e593a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:51.071731 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-21c95267-9bf7-48a3-8bbb-0b983b798532 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:51.076002 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-000960b5-c357-4d05-a32e-cce9688e593a tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1507 microversion: 2.1 time: 0.181165 Sep 06 21:21:51.076589 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 439/870] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:50 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1507 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:51.083847 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-21c95267-9bf7-48a3-8bbb-0b983b798532 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 200 len: 1278 microversion: 2.1 time: 0.276160 Sep 06 21:21:51.084423 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 432/871] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:50 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 1278 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:21:51.202862 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7e69486a-a5ea-4a2c-91a1-21804572791d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:51.203410 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7e69486a-a5ea-4a2c-91a1-21804572791d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:51.210183 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e69486a-a5ea-4a2c-91a1-21804572791d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:51.210677 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e69486a-a5ea-4a2c-91a1-21804572791d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:51.211117 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e69486a-a5ea-4a2c-91a1-21804572791d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:51.211832 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e69486a-a5ea-4a2c-91a1-21804572791d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:51.212496 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e69486a-a5ea-4a2c-91a1-21804572791d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:51.213120 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e69486a-a5ea-4a2c-91a1-21804572791d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:51.355632 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7e69486a-a5ea-4a2c-91a1-21804572791d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:51.364323 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7e69486a-a5ea-4a2c-91a1-21804572791d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1566 microversion: 2.1 time: 0.165477 Sep 06 21:21:51.364909 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 440/872] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:51 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:51.870759 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a1629f05-a207-416f-86cb-ccfe397de20a req-afac079c-93c3-4dce-b5b7-b0d74d8e7f76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4677a622-ebd6-468d-b82d-1a8b2ceae7d7", "tag": "abdf5cae-baf0-420e-8104-fe8acf77ad2f"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:21:51.879294 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:21:51.893212 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a1629f05-a207-416f-86cb-ccfe397de20a req-afac079c-93c3-4dce-b5b7-b0d74d8e7f76 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:51.893819 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a1629f05-a207-416f-86cb-ccfe397de20a req-afac079c-93c3-4dce-b5b7-b0d74d8e7f76 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:51.894310 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a1629f05-a207-416f-86cb-ccfe397de20a req-afac079c-93c3-4dce-b5b7-b0d74d8e7f76 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:51.906913 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a1629f05-a207-416f-86cb-ccfe397de20a req-afac079c-93c3-4dce-b5b7-b0d74d8e7f76 service nova] Creating event network-changed:abdf5cae-baf0-420e-8104-fe8acf77ad2f for instance 4677a622-ebd6-468d-b82d-1a8b2ceae7d7 on hv-cinder-74915 Sep 06 21:21:51.912297 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a1629f05-a207-416f-86cb-ccfe397de20a req-afac079c-93c3-4dce-b5b7-b0d74d8e7f76 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045286 Sep 06 21:21:51.913636 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 433/873] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 21:21:52.101973 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5044c6b6-3966-4577-b320-656d7e779367 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:52.102847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5044c6b6-3966-4577-b320-656d7e779367 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:52.108107 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-db370558-353f-4834-9393-289fd20395ba tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:52.108859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-db370558-353f-4834-9393-289fd20395ba tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:52.110315 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5044c6b6-3966-4577-b320-656d7e779367 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:52.110883 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5044c6b6-3966-4577-b320-656d7e779367 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:52.111379 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5044c6b6-3966-4577-b320-656d7e779367 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:52.112307 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5044c6b6-3966-4577-b320-656d7e779367 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:52.112830 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5044c6b6-3966-4577-b320-656d7e779367 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:52.113280 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5044c6b6-3966-4577-b320-656d7e779367 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:52.121096 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db370558-353f-4834-9393-289fd20395ba tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:52.121891 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db370558-353f-4834-9393-289fd20395ba tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:52.122520 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db370558-353f-4834-9393-289fd20395ba tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:52.123687 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db370558-353f-4834-9393-289fd20395ba tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:52.124575 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db370558-353f-4834-9393-289fd20395ba tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:52.125205 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db370558-353f-4834-9393-289fd20395ba tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:52.364141 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5044c6b6-3966-4577-b320-656d7e779367 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:52.365161 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-db370558-353f-4834-9393-289fd20395ba tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:52.377316 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5044c6b6-3966-4577-b320-656d7e779367 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1507 microversion: 2.1 time: 0.280064 Sep 06 21:21:52.388684 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 441/874] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:52 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1507 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:52.388684 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8b02eefc-f6ab-4f3e-9b57-27b0bd6c5af2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:52.388684 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8b02eefc-f6ab-4f3e-9b57-27b0bd6c5af2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:52.391217 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-db370558-353f-4834-9393-289fd20395ba tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 200 len: 1266 microversion: 2.1 time: 0.274623 Sep 06 21:21:52.397981 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 434/875] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:52 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 1266 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:52.406280 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-1b2abdc9-d597-4aa6-a7df-0e74f3d8ba03 req-9efe9bf1-2e92-4196-a90e-6792b6c7cc99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e16f683b-c2c3-4514-a197-cd5d4e109487", "name": "network-vif-deleted", "tag": "4bfe4568-94b9-4729-ae44-82a7f49cc312"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:21:52.407277 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b02eefc-f6ab-4f3e-9b57-27b0bd6c5af2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:52.407782 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b02eefc-f6ab-4f3e-9b57-27b0bd6c5af2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:52.408221 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b02eefc-f6ab-4f3e-9b57-27b0bd6c5af2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:52.411378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b02eefc-f6ab-4f3e-9b57-27b0bd6c5af2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:52.413348 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b02eefc-f6ab-4f3e-9b57-27b0bd6c5af2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:52.416321 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b02eefc-f6ab-4f3e-9b57-27b0bd6c5af2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:52.419611 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1b2abdc9-d597-4aa6-a7df-0e74f3d8ba03 req-9efe9bf1-2e92-4196-a90e-6792b6c7cc99 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:52.420077 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1b2abdc9-d597-4aa6-a7df-0e74f3d8ba03 req-9efe9bf1-2e92-4196-a90e-6792b6c7cc99 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:52.420693 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1b2abdc9-d597-4aa6-a7df-0e74f3d8ba03 req-9efe9bf1-2e92-4196-a90e-6792b6c7cc99 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:52.434123 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-1b2abdc9-d597-4aa6-a7df-0e74f3d8ba03 req-9efe9bf1-2e92-4196-a90e-6792b6c7cc99 service nova] Creating event network-vif-deleted:4bfe4568-94b9-4729-ae44-82a7f49cc312 for instance e16f683b-c2c3-4514-a197-cd5d4e109487 on hv-cinder-74915 Sep 06 21:21:52.439532 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-1b2abdc9-d597-4aa6-a7df-0e74f3d8ba03 req-9efe9bf1-2e92-4196-a90e-6792b6c7cc99 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039550 Sep 06 21:21:52.440463 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 435/876] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:21:52.572165 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8b02eefc-f6ab-4f3e-9b57-27b0bd6c5af2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:52.580697 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8b02eefc-f6ab-4f3e-9b57-27b0bd6c5af2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1566 microversion: 2.1 time: 0.197132 Sep 06 21:21:52.589785 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 442/877] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:52 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1566 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:21:53.409527 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8b8c66ba-c5d1-4c18-b22d-50f86cfae7d2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:53.410473 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8b8c66ba-c5d1-4c18-b22d-50f86cfae7d2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:53.419601 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b8c66ba-c5d1-4c18-b22d-50f86cfae7d2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:53.420053 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b8c66ba-c5d1-4c18-b22d-50f86cfae7d2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:53.420520 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b8c66ba-c5d1-4c18-b22d-50f86cfae7d2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:53.421248 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b8c66ba-c5d1-4c18-b22d-50f86cfae7d2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:53.421699 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b8c66ba-c5d1-4c18-b22d-50f86cfae7d2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:53.422120 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b8c66ba-c5d1-4c18-b22d-50f86cfae7d2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:53.425269 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6b5975cd-5845-48e4-9981-33646591b271 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:53.425873 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6b5975cd-5845-48e4-9981-33646591b271 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:53.433449 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b5975cd-5845-48e4-9981-33646591b271 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:53.433933 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b5975cd-5845-48e4-9981-33646591b271 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:53.434360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b5975cd-5845-48e4-9981-33646591b271 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:53.435047 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b5975cd-5845-48e4-9981-33646591b271 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:53.435481 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b5975cd-5845-48e4-9981-33646591b271 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:53.435897 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b5975cd-5845-48e4-9981-33646591b271 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:53.455892 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b8c66ba-c5d1-4c18-b22d-50f86cfae7d2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:53.456362 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b8c66ba-c5d1-4c18-b22d-50f86cfae7d2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:53.456825 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b8c66ba-c5d1-4c18-b22d-50f86cfae7d2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:53.457264 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-8b8c66ba-c5d1-4c18-b22d-50f86cfae7d2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lazy-loading 'fault' on Instance uuid e16f683b-c2c3-4514-a197-cd5d4e109487 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:21:53.503034 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8b8c66ba-c5d1-4c18-b22d-50f86cfae7d2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:53.511693 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8b8c66ba-c5d1-4c18-b22d-50f86cfae7d2 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 200 len: 1312 microversion: 2.1 time: 0.110179 Sep 06 21:21:53.521765 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 436/878] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:53 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 1312 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:53.571790 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6b5975cd-5845-48e4-9981-33646591b271 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:53.580981 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6b5975cd-5845-48e4-9981-33646591b271 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 200 len: 1266 microversion: 2.1 time: 0.159925 Sep 06 21:21:53.581585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 443/879] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:53 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:53.603520 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d674363c-b0df-44ea-979d-45458bbb2273 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:53.604257 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d674363c-b0df-44ea-979d-45458bbb2273 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:53.611385 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d674363c-b0df-44ea-979d-45458bbb2273 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:53.612180 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d674363c-b0df-44ea-979d-45458bbb2273 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:53.612691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d674363c-b0df-44ea-979d-45458bbb2273 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:53.613487 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d674363c-b0df-44ea-979d-45458bbb2273 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:53.613995 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d674363c-b0df-44ea-979d-45458bbb2273 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:53.614574 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d674363c-b0df-44ea-979d-45458bbb2273 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:53.813007 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d674363c-b0df-44ea-979d-45458bbb2273 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:53.821482 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d674363c-b0df-44ea-979d-45458bbb2273 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1566 microversion: 2.1 time: 0.221977 Sep 06 21:21:53.822103 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 437/880] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:53 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1566 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:54.538900 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-930a3606-2971-4b80-a548-72f226a1fe16 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:54.539729 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-930a3606-2971-4b80-a548-72f226a1fe16 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e16f683b-c2c3-4514-a197-cd5d4e109487] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:54.550674 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-930a3606-2971-4b80-a548-72f226a1fe16 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:54.551401 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-930a3606-2971-4b80-a548-72f226a1fe16 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:54.552043 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-930a3606-2971-4b80-a548-72f226a1fe16 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:54.553176 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-930a3606-2971-4b80-a548-72f226a1fe16 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:54.553910 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-930a3606-2971-4b80-a548-72f226a1fe16 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:54.554538 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-930a3606-2971-4b80-a548-72f226a1fe16 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:54.558431 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:21:54.570916 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-930a3606-2971-4b80-a548-72f226a1fe16 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] HTTP exception thrown: Instance e16f683b-c2c3-4514-a197-cd5d4e109487 could not be found. Sep 06 21:21:54.572585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-930a3606-2971-4b80-a548-72f226a1fe16 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Request method failure captured: Sep 06 21:21:54.572585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 HTTP/1.1 Sep 06 21:21:54.572585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:21:54.572585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:21:54.572585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:21:54.572585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:21:54.572585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:21:54.572585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:21:54.572585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:21:54.572585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:21:54.572585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7gUN_FLSnpNG9HSuch7Adumi07PvDapiWYlb4hdEBJJ-3oDVKZT8eH0XUiQphynu_EAk0GMMbuGt07jVLp2XHuc-gGocBp-HoFX8pN_ZBw-uxiJnYglnmqkenrCvYYKoQN5M4O4ySALb1G6TjikmxU7GQJcI9jL4bBNWv5FzOObxk8 Sep 06 21:21:54.572585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:21:54.572585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:21:54.572585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:21:54.572585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:21:54.572585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:21:54.572585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:21:54.572585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: ff397d6b3f4a42bf8b68b3bc55600dba Sep 06 21:21:54.572585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-456052109 Sep 06 21:21:54.572585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:21:54.572585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:21:54.574259 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ff397d6b3f4a42bf8b68b3bc55600dba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ff397d6b3f4a42bf8b68b3bc55600dba", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ff397d6b3f4a42bf8b68b3bc55600dba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ff397d6b3f4a42bf8b68b3bc55600dba"}]}] Sep 06 21:21:54.574259 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-ServerRescueNegativeTestJSON-456052109 Sep 06 21:21:54.574259 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: ff397d6b3f4a42bf8b68b3bc55600dba Sep 06 21:21:54.574259 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-456052109 Sep 06 21:21:54.574259 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-ServerRescueNegativeTestJSON-456052109-project Sep 06 21:21:54.574259 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:21:54.574259 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:21:54.574259 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: 2ec47d6e2e9b40a6bd207c084041f7a9 Sep 06 21:21:54.574259 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-ServerRescueNegativeTestJSON-456052109-project Sep 06 21:21:54.574259 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: > Sep 06 21:21:54.574259 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Instance e16f683b-c2c3-4514-a197-cd5d4e109487 could not be found. Sep 06 21:21:54.574259 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'id': 'e16f683b-c2c3-4514-a197-cd5d4e109487'} Sep 06 21:21:54.575135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:21:54.575135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:21:54.575135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:21:54.575135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:21:54.575135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:21:54.575135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:21:54.575135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:21:54.575135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:21:54.575135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:21:54.575135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:21:54.575135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e16f683b-c2c3-4514-a197-cd5d4e109487 could not be found. Sep 06 21:21:54.575135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:21:54.575135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:21:54.575135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:21:54.575135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:21:54.575135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:21:54.575135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:21:54.575135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:21:54.575135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:21:54.575135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:21:54.576519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:21:54.576519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:21:54.576519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:21:54.576519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:21:54.576519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:21:54.576519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:21:54.576519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:21:54.576519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e16f683b-c2c3-4514-a197-cd5d4e109487 could not be found. Sep 06 21:21:54.576519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:21:54.576519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:21:54.576519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:21:54.576519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:21:54.576519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:21:54.576519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:21:54.576519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:21:54.576519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:21:54.576519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e16f683b-c2c3-4514-a197-cd5d4e109487 could not be found. Sep 06 21:21:54.576519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:21:54.577974 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-930a3606-2971-4b80-a548-72f226a1fe16 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Returning 404 to user: Instance e16f683b-c2c3-4514-a197-cd5d4e109487 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:21:54.577974 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-930a3606-2971-4b80-a548-72f226a1fe16 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487" status: 404 len: 111 microversion: 2.1 time: 0.041738 Sep 06 21:21:54.577974 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 444/881] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:54 2022] GET /compute/v2.1/servers/e16f683b-c2c3-4514-a197-cd5d4e109487 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:21:54.582830 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0d087e46-cf2e-441e-a9af-c698bf619726 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:54.583341 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0d087e46-cf2e-441e-a9af-c698bf619726 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:54.592267 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d087e46-cf2e-441e-a9af-c698bf619726 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:54.592826 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d087e46-cf2e-441e-a9af-c698bf619726 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:54.593236 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d087e46-cf2e-441e-a9af-c698bf619726 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:54.593929 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d087e46-cf2e-441e-a9af-c698bf619726 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:54.594367 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d087e46-cf2e-441e-a9af-c698bf619726 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:54.594780 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d087e46-cf2e-441e-a9af-c698bf619726 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:54.604081 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-565a896c-04ec-4ae7-9724-3ac55150f932 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:54.604714 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-565a896c-04ec-4ae7-9724-3ac55150f932 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:54.611755 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-565a896c-04ec-4ae7-9724-3ac55150f932 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:54.612246 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-565a896c-04ec-4ae7-9724-3ac55150f932 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:54.612768 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-565a896c-04ec-4ae7-9724-3ac55150f932 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:54.613476 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-565a896c-04ec-4ae7-9724-3ac55150f932 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:54.613929 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-565a896c-04ec-4ae7-9724-3ac55150f932 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:54.614339 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-565a896c-04ec-4ae7-9724-3ac55150f932 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:54.620983 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0d087e46-cf2e-441e-a9af-c698bf619726 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 21:21:54.703082 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0d087e46-cf2e-441e-a9af-c698bf619726 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 204 len: 0 microversion: 2.1 time: 0.123819 Sep 06 21:21:54.703823 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 438/882] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Sep 6 21:21:54 2022] DELETE /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 21:21:54.712245 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-82aaf8e4-1f74-4865-9b1c-ff5891b25f07 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:54.713102 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-82aaf8e4-1f74-4865-9b1c-ff5891b25f07 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:54.719711 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82aaf8e4-1f74-4865-9b1c-ff5891b25f07 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:54.720199 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82aaf8e4-1f74-4865-9b1c-ff5891b25f07 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:54.720699 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82aaf8e4-1f74-4865-9b1c-ff5891b25f07 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:54.721443 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82aaf8e4-1f74-4865-9b1c-ff5891b25f07 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:54.721907 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82aaf8e4-1f74-4865-9b1c-ff5891b25f07 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:54.722328 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82aaf8e4-1f74-4865-9b1c-ff5891b25f07 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:54.756520 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-565a896c-04ec-4ae7-9724-3ac55150f932 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:54.764975 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-565a896c-04ec-4ae7-9724-3ac55150f932 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 200 len: 1266 microversion: 2.1 time: 0.164871 Sep 06 21:21:54.765788 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 445/883] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:54 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:54.845647 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-67e152bc-022f-4471-a363-791900d45c8a tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:54.846350 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-67e152bc-022f-4471-a363-791900d45c8a tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:54.852828 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67e152bc-022f-4471-a363-791900d45c8a tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:54.853305 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67e152bc-022f-4471-a363-791900d45c8a tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:54.853735 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67e152bc-022f-4471-a363-791900d45c8a tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:54.854567 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67e152bc-022f-4471-a363-791900d45c8a tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:54.854992 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67e152bc-022f-4471-a363-791900d45c8a tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:54.855416 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67e152bc-022f-4471-a363-791900d45c8a tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:54.857386 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-82aaf8e4-1f74-4865-9b1c-ff5891b25f07 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:54.866028 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-82aaf8e4-1f74-4865-9b1c-ff5891b25f07 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1521 microversion: 2.1 time: 0.157905 Sep 06 21:21:54.866635 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 439/884] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:54 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:21:54.994979 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-67e152bc-022f-4471-a363-791900d45c8a tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:55.007499 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-67e152bc-022f-4471-a363-791900d45c8a tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1566 microversion: 2.1 time: 0.165555 Sep 06 21:21:55.008424 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 446/885] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:54 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:55.787986 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eb4b8b64-c0a1-4f68-aaa9-8d3929969783 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:55.788561 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eb4b8b64-c0a1-4f68-aaa9-8d3929969783 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:55.795509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb4b8b64-c0a1-4f68-aaa9-8d3929969783 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:55.795929 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb4b8b64-c0a1-4f68-aaa9-8d3929969783 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:55.796378 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb4b8b64-c0a1-4f68-aaa9-8d3929969783 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:55.797087 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb4b8b64-c0a1-4f68-aaa9-8d3929969783 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:55.797872 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb4b8b64-c0a1-4f68-aaa9-8d3929969783 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:55.798282 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb4b8b64-c0a1-4f68-aaa9-8d3929969783 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:55.890604 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e8837af5-658c-4e31-8d32-0f4bb38bd88b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:55.891215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e8837af5-658c-4e31-8d32-0f4bb38bd88b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:55.898288 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8837af5-658c-4e31-8d32-0f4bb38bd88b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:55.898769 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8837af5-658c-4e31-8d32-0f4bb38bd88b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:55.899202 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8837af5-658c-4e31-8d32-0f4bb38bd88b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:55.899889 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8837af5-658c-4e31-8d32-0f4bb38bd88b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:55.900333 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8837af5-658c-4e31-8d32-0f4bb38bd88b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:55.900777 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8837af5-658c-4e31-8d32-0f4bb38bd88b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:55.938550 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-eb4b8b64-c0a1-4f68-aaa9-8d3929969783 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:55.946972 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eb4b8b64-c0a1-4f68-aaa9-8d3929969783 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 200 len: 1266 microversion: 2.1 time: 0.162776 Sep 06 21:21:55.947574 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 440/886] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:55 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:56.031760 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-642f2fa3-85d1-4871-bd66-ca8a597e6fda tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:56.032369 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-642f2fa3-85d1-4871-bd66-ca8a597e6fda tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:56.038279 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e8837af5-658c-4e31-8d32-0f4bb38bd88b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:56.038920 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-642f2fa3-85d1-4871-bd66-ca8a597e6fda tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:56.039407 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-642f2fa3-85d1-4871-bd66-ca8a597e6fda tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:56.039845 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-642f2fa3-85d1-4871-bd66-ca8a597e6fda tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:56.040598 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-642f2fa3-85d1-4871-bd66-ca8a597e6fda tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:56.041037 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-642f2fa3-85d1-4871-bd66-ca8a597e6fda tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:56.041452 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-642f2fa3-85d1-4871-bd66-ca8a597e6fda tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:56.046478 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e8837af5-658c-4e31-8d32-0f4bb38bd88b tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1521 microversion: 2.1 time: 0.159662 Sep 06 21:21:56.046955 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 447/887] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:55 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:21:56.187563 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-642f2fa3-85d1-4871-bd66-ca8a597e6fda tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:56.201497 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-642f2fa3-85d1-4871-bd66-ca8a597e6fda tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1566 microversion: 2.1 time: 0.173736 Sep 06 21:21:56.202128 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 441/888] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:56 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:56.970204 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-924a2f94-ee2a-4429-b4d5-14dae5393d25 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:56.970940 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-924a2f94-ee2a-4429-b4d5-14dae5393d25 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:56.977752 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-924a2f94-ee2a-4429-b4d5-14dae5393d25 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:56.978312 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-924a2f94-ee2a-4429-b4d5-14dae5393d25 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:56.978802 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-924a2f94-ee2a-4429-b4d5-14dae5393d25 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:56.979617 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-924a2f94-ee2a-4429-b4d5-14dae5393d25 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:56.980135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-924a2f94-ee2a-4429-b4d5-14dae5393d25 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:56.980754 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-924a2f94-ee2a-4429-b4d5-14dae5393d25 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:57.070614 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e55de68f-51bc-4083-a1ba-8a74b4ef2bf1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:57.072444 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e55de68f-51bc-4083-a1ba-8a74b4ef2bf1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:57.081015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e55de68f-51bc-4083-a1ba-8a74b4ef2bf1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:57.082138 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e55de68f-51bc-4083-a1ba-8a74b4ef2bf1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:57.082897 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e55de68f-51bc-4083-a1ba-8a74b4ef2bf1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:57.084174 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e55de68f-51bc-4083-a1ba-8a74b4ef2bf1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:57.084868 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e55de68f-51bc-4083-a1ba-8a74b4ef2bf1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:57.085506 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e55de68f-51bc-4083-a1ba-8a74b4ef2bf1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:57.125267 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-924a2f94-ee2a-4429-b4d5-14dae5393d25 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:57.134482 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-924a2f94-ee2a-4429-b4d5-14dae5393d25 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 200 len: 1266 microversion: 2.1 time: 0.168149 Sep 06 21:21:57.135269 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 448/889] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:56 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:57.225261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-553d8b8c-0d6d-4773-8f57-235406755331 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:57.225875 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-553d8b8c-0d6d-4773-8f57-235406755331 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:57.233262 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-553d8b8c-0d6d-4773-8f57-235406755331 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:57.233993 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-553d8b8c-0d6d-4773-8f57-235406755331 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:57.234626 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-553d8b8c-0d6d-4773-8f57-235406755331 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:57.235496 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-553d8b8c-0d6d-4773-8f57-235406755331 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:57.236100 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-553d8b8c-0d6d-4773-8f57-235406755331 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:57.236712 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-553d8b8c-0d6d-4773-8f57-235406755331 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:57.297267 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e55de68f-51bc-4083-a1ba-8a74b4ef2bf1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec47d6e2e9b40a6bd207c084041f7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff397d6b3f4a42bf8b68b3bc55600dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:57.305823 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e55de68f-51bc-4083-a1ba-8a74b4ef2bf1 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 200 len: 1521 microversion: 2.1 time: 0.238951 Sep 06 21:21:57.320742 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 442/890] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:57 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:21:57.374373 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-553d8b8c-0d6d-4773-8f57-235406755331 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:57.382285 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-553d8b8c-0d6d-4773-8f57-235406755331 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1566 microversion: 2.1 time: 0.161081 Sep 06 21:21:57.382926 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 449/891] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:57 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:57.479085 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-80bc765f-46b0-439f-aeee-e868dd308dac req-e6c53945-befb-46c0-a07b-5be14e4d2107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4f062bd-6aa2-4c00-86a3-7ddc003c1713", "name": "network-vif-deleted", "tag": "5502eac9-cbbf-4d67-87b5-f4110ae65ddf"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:21:57.489347 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-80bc765f-46b0-439f-aeee-e868dd308dac req-e6c53945-befb-46c0-a07b-5be14e4d2107 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:57.489821 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-80bc765f-46b0-439f-aeee-e868dd308dac req-e6c53945-befb-46c0-a07b-5be14e4d2107 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:57.490248 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-80bc765f-46b0-439f-aeee-e868dd308dac req-e6c53945-befb-46c0-a07b-5be14e4d2107 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:57.503588 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-80bc765f-46b0-439f-aeee-e868dd308dac req-e6c53945-befb-46c0-a07b-5be14e4d2107 service nova] Creating event network-vif-deleted:5502eac9-cbbf-4d67-87b5-f4110ae65ddf for instance e4f062bd-6aa2-4c00-86a3-7ddc003c1713 on hv-cinder-74915 Sep 06 21:21:57.508549 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-80bc765f-46b0-439f-aeee-e868dd308dac req-e6c53945-befb-46c0-a07b-5be14e4d2107 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033420 Sep 06 21:21:57.509181 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 443/892] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:21:58.159052 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2f90f461-6922-4dec-9d7e-209a82b6c04b tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:58.159686 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2f90f461-6922-4dec-9d7e-209a82b6c04b tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:58.166492 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f90f461-6922-4dec-9d7e-209a82b6c04b tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:58.166983 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f90f461-6922-4dec-9d7e-209a82b6c04b tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:58.167516 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f90f461-6922-4dec-9d7e-209a82b6c04b tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:58.168220 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f90f461-6922-4dec-9d7e-209a82b6c04b tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:58.168670 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f90f461-6922-4dec-9d7e-209a82b6c04b tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:58.169115 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f90f461-6922-4dec-9d7e-209a82b6c04b tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:58.316455 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2f90f461-6922-4dec-9d7e-209a82b6c04b tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:58.324503 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2f90f461-6922-4dec-9d7e-209a82b6c04b tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 200 len: 1266 microversion: 2.1 time: 0.169636 Sep 06 21:21:58.325175 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 450/893] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:58 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:58.330696 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dee6a101-473d-499f-aad8-3294fad76362 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:58.331939 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dee6a101-473d-499f-aad8-3294fad76362 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] [instance: e4f062bd-6aa2-4c00-86a3-7ddc003c1713] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:58.339552 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dee6a101-473d-499f-aad8-3294fad76362 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:58.340081 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dee6a101-473d-499f-aad8-3294fad76362 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:58.340557 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dee6a101-473d-499f-aad8-3294fad76362 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:58.341548 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dee6a101-473d-499f-aad8-3294fad76362 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:58.342152 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dee6a101-473d-499f-aad8-3294fad76362 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:58.342727 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dee6a101-473d-499f-aad8-3294fad76362 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:58.357673 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-dee6a101-473d-499f-aad8-3294fad76362 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] HTTP exception thrown: Instance e4f062bd-6aa2-4c00-86a3-7ddc003c1713 could not be found. Sep 06 21:21:58.359315 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dee6a101-473d-499f-aad8-3294fad76362 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Request method failure captured: Sep 06 21:21:58.359315 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 HTTP/1.1 Sep 06 21:21:58.359315 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 06 21:21:58.359315 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 06 21:21:58.359315 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Connection: close Sep 06 21:21:58.359315 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 06 21:21:58.359315 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 06 21:21:58.359315 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Host: 10.222.0.79 Sep 06 21:21:58.359315 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 06 21:21:58.359315 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 06 21:21:58.359315 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjF7gUN_FLSnpNG9HSuch7Adumi07PvDapiWYlb4hdEBJJ-3oDVKZT8eH0XUiQphynu_EAk0GMMbuGt07jVLp2XHuc-gGocBp-HoFX8pN_ZBw-uxiJnYglnmqkenrCvYYKoQN5M4O4ySALb1G6TjikmxU7GQJcI9jL4bBNWv5FzOObxk8 Sep 06 21:21:58.359315 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 06 21:21:58.359315 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 06 21:21:58.359315 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 06 21:21:58.359315 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 06 21:21:58.359315 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 06 21:21:58.359315 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 06 21:21:58.359315 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Id: ff397d6b3f4a42bf8b68b3bc55600dba Sep 06 21:21:58.359315 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-456052109 Sep 06 21:21:58.359315 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Role: reader,member Sep 06 21:21:58.359315 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Sep 06 21:21:58.360829 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ff397d6b3f4a42bf8b68b3bc55600dba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ff397d6b3f4a42bf8b68b3bc55600dba", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ff397d6b3f4a42bf8b68b3bc55600dba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ff397d6b3f4a42bf8b68b3bc55600dba"}]}] Sep 06 21:21:58.360829 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-ServerRescueNegativeTestJSON-456052109 Sep 06 21:21:58.360829 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Id: ff397d6b3f4a42bf8b68b3bc55600dba Sep 06 21:21:58.360829 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-456052109 Sep 06 21:21:58.360829 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User: tempest-ServerRescueNegativeTestJSON-456052109-project Sep 06 21:21:58.360829 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 06 21:21:58.360829 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 06 21:21:58.360829 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Id: 2ec47d6e2e9b40a6bd207c084041f7a9 Sep 06 21:21:58.360829 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-ServerRescueNegativeTestJSON-456052109-project Sep 06 21:21:58.360829 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: method: > Sep 06 21:21:58.360829 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: exception: Instance e4f062bd-6aa2-4c00-86a3-7ddc003c1713 could not be found. Sep 06 21:21:58.360829 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: action_args: {'id': 'e4f062bd-6aa2-4c00-86a3-7ddc003c1713'} Sep 06 21:21:58.361700 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:21:58.361700 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:21:58.361700 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:21:58.361700 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:21:58.361700 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:21:58.361700 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:21:58.361700 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:21:58.361700 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:21:58.361700 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:21:58.361700 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:21:58.361700 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4f062bd-6aa2-4c00-86a3-7ddc003c1713 could not be found. Sep 06 21:21:58.361700 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:21:58.361700 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:21:58.361700 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:21:58.361700 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:21:58.361700 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:21:58.361700 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:21:58.361700 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:21:58.361700 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:21:58.361700 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:21:58.363118 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:21:58.363118 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:21:58.363118 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:21:58.363118 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:21:58.363118 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:21:58.363118 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:21:58.363118 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:21:58.363118 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4f062bd-6aa2-4c00-86a3-7ddc003c1713 could not be found. Sep 06 21:21:58.363118 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:21:58.363118 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:21:58.363118 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:21:58.363118 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:21:58.363118 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:21:58.363118 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:21:58.363118 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:21:58.363118 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:21:58.363118 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4f062bd-6aa2-4c00-86a3-7ddc003c1713 could not be found. Sep 06 21:21:58.363118 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:21:58.364516 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dee6a101-473d-499f-aad8-3294fad76362 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] Returning 404 to user: Instance e4f062bd-6aa2-4c00-86a3-7ddc003c1713 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:21:58.364516 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dee6a101-473d-499f-aad8-3294fad76362 tempest-ServerRescueNegativeTestJSON-456052109 tempest-ServerRescueNegativeTestJSON-456052109-project] 10.222.0.79 "GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713" status: 404 len: 111 microversion: 2.1 time: 0.034664 Sep 06 21:21:58.364853 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 444/894] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:58 2022] GET /compute/v2.1/servers/e4f062bd-6aa2-4c00-86a3-7ddc003c1713 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 21:21:58.406562 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6df049ae-81ed-4c67-b34c-d6d56bbb8531 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:58.407163 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6df049ae-81ed-4c67-b34c-d6d56bbb8531 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:58.409052 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:21:58.409937 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:21:58.415845 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6df049ae-81ed-4c67-b34c-d6d56bbb8531 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:58.415987 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6df049ae-81ed-4c67-b34c-d6d56bbb8531 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:58.416414 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6df049ae-81ed-4c67-b34c-d6d56bbb8531 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:58.417140 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6df049ae-81ed-4c67-b34c-d6d56bbb8531 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:58.417586 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6df049ae-81ed-4c67-b34c-d6d56bbb8531 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:58.418003 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6df049ae-81ed-4c67-b34c-d6d56bbb8531 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:58.553565 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6df049ae-81ed-4c67-b34c-d6d56bbb8531 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:58.561465 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6df049ae-81ed-4c67-b34c-d6d56bbb8531 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1566 microversion: 2.1 time: 0.158869 Sep 06 21:21:58.562010 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 451/895] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:58 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:59.351350 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e37a704c-0380-49a3-b003-1923fdcb111c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:59.351929 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e37a704c-0380-49a3-b003-1923fdcb111c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:59.353979 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:21:59.359870 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e37a704c-0380-49a3-b003-1923fdcb111c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:59.360354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e37a704c-0380-49a3-b003-1923fdcb111c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:59.360810 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e37a704c-0380-49a3-b003-1923fdcb111c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:59.361506 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e37a704c-0380-49a3-b003-1923fdcb111c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:59.361949 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e37a704c-0380-49a3-b003-1923fdcb111c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:59.362362 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e37a704c-0380-49a3-b003-1923fdcb111c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:59.585028 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fd85aa76-246d-448e-88f6-179c098dfe5b tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:21:59.585599 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fd85aa76-246d-448e-88f6-179c098dfe5b tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:21:59.593033 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd85aa76-246d-448e-88f6-179c098dfe5b tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:59.593343 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd85aa76-246d-448e-88f6-179c098dfe5b tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:59.593779 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd85aa76-246d-448e-88f6-179c098dfe5b tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:59.594483 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd85aa76-246d-448e-88f6-179c098dfe5b tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:21:59.594928 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd85aa76-246d-448e-88f6-179c098dfe5b tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:21:59.595343 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd85aa76-246d-448e-88f6-179c098dfe5b tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:21:59.616357 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e37a704c-0380-49a3-b003-1923fdcb111c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:59.625205 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e37a704c-0380-49a3-b003-1923fdcb111c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 200 len: 1266 microversion: 2.1 time: 0.277709 Sep 06 21:21:59.625781 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 445/896] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:59 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 1266 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:21:59.732540 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-fd85aa76-246d-448e-88f6-179c098dfe5b tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:21:59.746168 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fd85aa76-246d-448e-88f6-179c098dfe5b tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1566 microversion: 2.1 time: 0.165138 Sep 06 21:21:59.746728 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 452/897] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:21:59 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:22:00.648210 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d594f223-46c9-4d85-b3d1-ff278b25f655 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:00.648898 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d594f223-46c9-4d85-b3d1-ff278b25f655 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:00.661915 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d594f223-46c9-4d85-b3d1-ff278b25f655 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:00.662614 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d594f223-46c9-4d85-b3d1-ff278b25f655 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:00.663277 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d594f223-46c9-4d85-b3d1-ff278b25f655 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:00.664294 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d594f223-46c9-4d85-b3d1-ff278b25f655 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:00.668325 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d594f223-46c9-4d85-b3d1-ff278b25f655 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:00.669119 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d594f223-46c9-4d85-b3d1-ff278b25f655 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:00.721001 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:00.770382 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-04003c2f-126a-475b-89ac-e060c9a9bb49 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:00.770999 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-04003c2f-126a-475b-89ac-e060c9a9bb49 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:00.777845 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04003c2f-126a-475b-89ac-e060c9a9bb49 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:00.778364 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04003c2f-126a-475b-89ac-e060c9a9bb49 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:00.778797 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04003c2f-126a-475b-89ac-e060c9a9bb49 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:00.779503 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04003c2f-126a-475b-89ac-e060c9a9bb49 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:00.779978 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04003c2f-126a-475b-89ac-e060c9a9bb49 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:00.780588 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-04003c2f-126a-475b-89ac-e060c9a9bb49 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:00.914661 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-04003c2f-126a-475b-89ac-e060c9a9bb49 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:00.919066 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d594f223-46c9-4d85-b3d1-ff278b25f655 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:00.924332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-04003c2f-126a-475b-89ac-e060c9a9bb49 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1566 microversion: 2.1 time: 0.157742 Sep 06 21:22:00.936742 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 453/898] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:00 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:22:00.936942 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d594f223-46c9-4d85-b3d1-ff278b25f655 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 200 len: 1266 microversion: 2.1 time: 0.282912 Sep 06 21:22:00.936942 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 446/899] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:00 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 1266 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:01.952894 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1c7e9ff3-514e-4974-9ac1-b899b21a34e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:01.955644 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4e386726-53cc-4d53-a68d-ae0f6841d4b6 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:01.956768 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4e386726-53cc-4d53-a68d-ae0f6841d4b6 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:01.960904 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1c7e9ff3-514e-4974-9ac1-b899b21a34e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:01.973942 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c7e9ff3-514e-4974-9ac1-b899b21a34e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:01.974413 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c7e9ff3-514e-4974-9ac1-b899b21a34e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:01.974839 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c7e9ff3-514e-4974-9ac1-b899b21a34e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:01.977255 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c7e9ff3-514e-4974-9ac1-b899b21a34e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:01.978717 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e386726-53cc-4d53-a68d-ae0f6841d4b6 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:01.979324 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e386726-53cc-4d53-a68d-ae0f6841d4b6 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:01.979596 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e386726-53cc-4d53-a68d-ae0f6841d4b6 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:01.980505 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e386726-53cc-4d53-a68d-ae0f6841d4b6 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:01.981264 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e386726-53cc-4d53-a68d-ae0f6841d4b6 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:01.981925 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e386726-53cc-4d53-a68d-ae0f6841d4b6 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:01.982479 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c7e9ff3-514e-4974-9ac1-b899b21a34e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:01.985922 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c7e9ff3-514e-4974-9ac1-b899b21a34e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:02.173836 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4e386726-53cc-4d53-a68d-ae0f6841d4b6 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:02.182921 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4e386726-53cc-4d53-a68d-ae0f6841d4b6 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1566 microversion: 2.1 time: 0.238338 Sep 06 21:22:02.197441 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 454/900] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:01 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1566 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:02.223172 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-4e08a7de-5b28-44a9-84c8-a49f12aa1161 req-d82d4b1b-5ee6-46cf-bc6b-8752588922db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4677a622-ebd6-468d-b82d-1a8b2ceae7d7", "name": "network-vif-plugged", "status": "completed", "tag": "abdf5cae-baf0-420e-8104-fe8acf77ad2f"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:22:02.241733 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4e08a7de-5b28-44a9-84c8-a49f12aa1161 req-d82d4b1b-5ee6-46cf-bc6b-8752588922db service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:02.243466 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4e08a7de-5b28-44a9-84c8-a49f12aa1161 req-d82d4b1b-5ee6-46cf-bc6b-8752588922db service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:02.250352 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4e08a7de-5b28-44a9-84c8-a49f12aa1161 req-d82d4b1b-5ee6-46cf-bc6b-8752588922db service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:02.273854 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-4e08a7de-5b28-44a9-84c8-a49f12aa1161 req-d82d4b1b-5ee6-46cf-bc6b-8752588922db service nova] Creating event network-vif-plugged:abdf5cae-baf0-420e-8104-fe8acf77ad2f for instance 4677a622-ebd6-468d-b82d-1a8b2ceae7d7 on hv-cinder-74915 Sep 06 21:22:02.281822 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-4e08a7de-5b28-44a9-84c8-a49f12aa1161 req-d82d4b1b-5ee6-46cf-bc6b-8752588922db service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064381 Sep 06 21:22:02.282837 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 455/901] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 21:22:02.366175 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1c7e9ff3-514e-4974-9ac1-b899b21a34e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:02.383584 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1c7e9ff3-514e-4974-9ac1-b899b21a34e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 200 len: 1266 microversion: 2.1 time: 0.436061 Sep 06 21:22:02.384337 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 447/902] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:01 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 1266 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:03.208449 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e1e55d78-f26e-46e8-8bc5-2997c7a5ad93 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:03.209158 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e1e55d78-f26e-46e8-8bc5-2997c7a5ad93 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:03.216949 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1e55d78-f26e-46e8-8bc5-2997c7a5ad93 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:03.217452 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1e55d78-f26e-46e8-8bc5-2997c7a5ad93 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:03.217877 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1e55d78-f26e-46e8-8bc5-2997c7a5ad93 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:03.218623 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1e55d78-f26e-46e8-8bc5-2997c7a5ad93 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:03.219068 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1e55d78-f26e-46e8-8bc5-2997c7a5ad93 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:03.219482 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1e55d78-f26e-46e8-8bc5-2997c7a5ad93 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:03.354935 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e1e55d78-f26e-46e8-8bc5-2997c7a5ad93 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:03.362967 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e1e55d78-f26e-46e8-8bc5-2997c7a5ad93 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1567 microversion: 2.1 time: 0.159433 Sep 06 21:22:03.363465 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 456/903] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:03 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:03.386406 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d70c3bd6-a41d-4c63-a50d-9c670efd684e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:22:03.386995 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d70c3bd6-a41d-4c63-a50d-9c670efd684e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:03.393601 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d70c3bd6-a41d-4c63-a50d-9c670efd684e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:03.394079 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d70c3bd6-a41d-4c63-a50d-9c670efd684e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:03.394503 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d70c3bd6-a41d-4c63-a50d-9c670efd684e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:03.395199 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d70c3bd6-a41d-4c63-a50d-9c670efd684e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:03.395633 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d70c3bd6-a41d-4c63-a50d-9c670efd684e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:03.396064 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d70c3bd6-a41d-4c63-a50d-9c670efd684e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:03.415207 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f423f25c-8882-4d7f-9d0a-249fc3989c5d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:03.415835 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f423f25c-8882-4d7f-9d0a-249fc3989c5d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:03.423123 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f423f25c-8882-4d7f-9d0a-249fc3989c5d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:03.423663 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f423f25c-8882-4d7f-9d0a-249fc3989c5d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:03.424103 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f423f25c-8882-4d7f-9d0a-249fc3989c5d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:03.424852 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f423f25c-8882-4d7f-9d0a-249fc3989c5d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:03.425324 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f423f25c-8882-4d7f-9d0a-249fc3989c5d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:03.425733 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f423f25c-8882-4d7f-9d0a-249fc3989c5d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:03.447076 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d70c3bd6-a41d-4c63-a50d-9c670efd684e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120720) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 06 21:22:03.538070 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d70c3bd6-a41d-4c63-a50d-9c670efd684e tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "POST /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8/action" status: 202 len: 0 microversion: 2.1 time: 0.154989 Sep 06 21:22:03.539164 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 448/904] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Sep 6 21:22:03 2022] POST /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:22:03.548490 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a6fd2bda-11ec-4140-a556-3a7f840135a1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:03.558390 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a6fd2bda-11ec-4140-a556-3a7f840135a1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:03.568484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6fd2bda-11ec-4140-a556-3a7f840135a1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:03.569398 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6fd2bda-11ec-4140-a556-3a7f840135a1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:03.570172 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6fd2bda-11ec-4140-a556-3a7f840135a1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:03.570785 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6fd2bda-11ec-4140-a556-3a7f840135a1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:03.571285 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6fd2bda-11ec-4140-a556-3a7f840135a1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:03.571804 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6fd2bda-11ec-4140-a556-3a7f840135a1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:03.630126 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f423f25c-8882-4d7f-9d0a-249fc3989c5d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:03.639859 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f423f25c-8882-4d7f-9d0a-249fc3989c5d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 200 len: 1266 microversion: 2.1 time: 0.228346 Sep 06 21:22:03.641727 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 457/905] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:03 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:22:03.757263 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a6fd2bda-11ec-4140-a556-3a7f840135a1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:03.768644 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a6fd2bda-11ec-4140-a556-3a7f840135a1 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1575 microversion: 2.1 time: 0.224629 Sep 06 21:22:03.795451 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 449/906] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:03 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1575 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:22:04.664240 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d41ff741-b59c-4194-a56d-235c64f0b261 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:04.665618 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d41ff741-b59c-4194-a56d-235c64f0b261 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:04.672225 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d41ff741-b59c-4194-a56d-235c64f0b261 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:04.673124 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d41ff741-b59c-4194-a56d-235c64f0b261 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:04.673531 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d41ff741-b59c-4194-a56d-235c64f0b261 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:04.674261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d41ff741-b59c-4194-a56d-235c64f0b261 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:04.674668 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d41ff741-b59c-4194-a56d-235c64f0b261 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:04.675291 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d41ff741-b59c-4194-a56d-235c64f0b261 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:04.793163 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cf1722bd-2123-4c6b-a357-9313d148a157 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:04.794464 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cf1722bd-2123-4c6b-a357-9313d148a157 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:04.802455 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf1722bd-2123-4c6b-a357-9313d148a157 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:04.802993 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf1722bd-2123-4c6b-a357-9313d148a157 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:04.803694 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf1722bd-2123-4c6b-a357-9313d148a157 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:04.804917 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf1722bd-2123-4c6b-a357-9313d148a157 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:04.805528 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf1722bd-2123-4c6b-a357-9313d148a157 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:04.806095 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf1722bd-2123-4c6b-a357-9313d148a157 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:04.949453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d41ff741-b59c-4194-a56d-235c64f0b261 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:04.974170 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d41ff741-b59c-4194-a56d-235c64f0b261 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 200 len: 1453 microversion: 2.1 time: 0.313598 Sep 06 21:22:04.978257 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 458/907] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:04 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 1453 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:05.002761 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-19356d3c-b9c7-4944-ab2e-4c712ddad850 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:05.003748 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-19356d3c-b9c7-4944-ab2e-4c712ddad850 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:05.014326 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19356d3c-b9c7-4944-ab2e-4c712ddad850 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:05.019620 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19356d3c-b9c7-4944-ab2e-4c712ddad850 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:05.020352 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19356d3c-b9c7-4944-ab2e-4c712ddad850 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:05.021305 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19356d3c-b9c7-4944-ab2e-4c712ddad850 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:05.022125 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19356d3c-b9c7-4944-ab2e-4c712ddad850 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:05.022268 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19356d3c-b9c7-4944-ab2e-4c712ddad850 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:05.049842 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cf1722bd-2123-4c6b-a357-9313d148a157 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:05.058501 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cf1722bd-2123-4c6b-a357-9313d148a157 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1515 microversion: 2.1 time: 0.269706 Sep 06 21:22:05.079194 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 450/908] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:04 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1515 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:22:05.532168 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-19356d3c-b9c7-4944-ab2e-4c712ddad850 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:05.540717 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-19356d3c-b9c7-4944-ab2e-4c712ddad850 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 200 len: 1453 microversion: 2.1 time: 0.542068 Sep 06 21:22:05.541635 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 459/909] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:04 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 1453 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:22:05.880499 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-0398d439-ef87-4bdd-9316-b8ff2255f539 req-50229abf-d43d-4ed1-b999-d3da2c15c2a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "340de6d7-883f-4c26-89b1-4f8536aa09e8", "name": "network-vif-unplugged", "status": "completed", "tag": "e03713ad-150d-4e1c-af49-98c4a6fe49fe"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:22:05.898974 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0398d439-ef87-4bdd-9316-b8ff2255f539 req-50229abf-d43d-4ed1-b999-d3da2c15c2a2 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:05.901908 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0398d439-ef87-4bdd-9316-b8ff2255f539 req-50229abf-d43d-4ed1-b999-d3da2c15c2a2 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:05.902612 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0398d439-ef87-4bdd-9316-b8ff2255f539 req-50229abf-d43d-4ed1-b999-d3da2c15c2a2 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:05.928773 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.compute.server_external_events [req-0398d439-ef87-4bdd-9316-b8ff2255f539 req-50229abf-d43d-4ed1-b999-d3da2c15c2a2 service nova] Unable to find a host for instance 340de6d7-883f-4c26-89b1-4f8536aa09e8. Dropping event network-vif-unplugged {{(pid=120720) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 06 21:22:05.938456 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-0398d439-ef87-4bdd-9316-b8ff2255f539 req-50229abf-d43d-4ed1-b999-d3da2c15c2a2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.053950 Sep 06 21:22:05.939448 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 451/910] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 64 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 06 21:22:06.086818 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4339e6b6-86f1-4053-8465-50fafffd6a05 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:06.088502 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4339e6b6-86f1-4053-8465-50fafffd6a05 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:06.100567 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4339e6b6-86f1-4053-8465-50fafffd6a05 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:06.101384 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4339e6b6-86f1-4053-8465-50fafffd6a05 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:06.101983 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4339e6b6-86f1-4053-8465-50fafffd6a05 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:06.102918 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4339e6b6-86f1-4053-8465-50fafffd6a05 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:06.103536 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4339e6b6-86f1-4053-8465-50fafffd6a05 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:06.104144 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4339e6b6-86f1-4053-8465-50fafffd6a05 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:06.374265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4339e6b6-86f1-4053-8465-50fafffd6a05 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:06.406385 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4339e6b6-86f1-4053-8465-50fafffd6a05 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1517 microversion: 2.1 time: 0.326571 Sep 06 21:22:06.409624 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 460/911] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:06 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1517 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:07.433940 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d5d58d80-a60f-457b-a218-b58143382124 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:07.435199 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d5d58d80-a60f-457b-a218-b58143382124 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:07.441714 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5d58d80-a60f-457b-a218-b58143382124 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:07.442195 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5d58d80-a60f-457b-a218-b58143382124 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:07.442821 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5d58d80-a60f-457b-a218-b58143382124 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:07.443697 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5d58d80-a60f-457b-a218-b58143382124 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:07.444321 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5d58d80-a60f-457b-a218-b58143382124 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:07.444990 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5d58d80-a60f-457b-a218-b58143382124 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:07.780745 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d5d58d80-a60f-457b-a218-b58143382124 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:07.789223 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d5d58d80-a60f-457b-a218-b58143382124 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1573 microversion: 2.1 time: 0.359009 Sep 06 21:22:07.789905 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 452/912] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:07 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1573 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:08.521674 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-ec124c5c-2af6-472f-bd01-d38afa7baa30 req-860eb23e-8766-438c-a6cb-7e7d95712449 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4677a622-ebd6-468d-b82d-1a8b2ceae7d7", "tag": "abdf5cae-baf0-420e-8104-fe8acf77ad2f"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:22:08.532196 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ec124c5c-2af6-472f-bd01-d38afa7baa30 req-860eb23e-8766-438c-a6cb-7e7d95712449 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:08.532687 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ec124c5c-2af6-472f-bd01-d38afa7baa30 req-860eb23e-8766-438c-a6cb-7e7d95712449 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:08.533143 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ec124c5c-2af6-472f-bd01-d38afa7baa30 req-860eb23e-8766-438c-a6cb-7e7d95712449 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:08.548158 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-ec124c5c-2af6-472f-bd01-d38afa7baa30 req-860eb23e-8766-438c-a6cb-7e7d95712449 service nova] Creating event network-changed:abdf5cae-baf0-420e-8104-fe8acf77ad2f for instance 4677a622-ebd6-468d-b82d-1a8b2ceae7d7 on hv-cinder-74915 Sep 06 21:22:08.559947 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-ec124c5c-2af6-472f-bd01-d38afa7baa30 req-860eb23e-8766-438c-a6cb-7e7d95712449 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045096 Sep 06 21:22:08.561214 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 461/913] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:22:08.816696 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f4bad0bf-ccb1-4e75-8693-7e4c2db7d3ad tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:08.818470 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f4bad0bf-ccb1-4e75-8693-7e4c2db7d3ad tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:08.833910 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4bad0bf-ccb1-4e75-8693-7e4c2db7d3ad tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:08.835910 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4bad0bf-ccb1-4e75-8693-7e4c2db7d3ad tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:08.839413 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4bad0bf-ccb1-4e75-8693-7e4c2db7d3ad tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:08.840602 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4bad0bf-ccb1-4e75-8693-7e4c2db7d3ad tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:08.841422 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4bad0bf-ccb1-4e75-8693-7e4c2db7d3ad tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:08.842072 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4bad0bf-ccb1-4e75-8693-7e4c2db7d3ad tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:09.081674 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f4bad0bf-ccb1-4e75-8693-7e4c2db7d3ad tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:09.094635 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f4bad0bf-ccb1-4e75-8693-7e4c2db7d3ad tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1573 microversion: 2.1 time: 0.283791 Sep 06 21:22:09.109231 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 453/914] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:08 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1573 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:10.006484 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-520f3e31-d883-4eb0-8a0c-757b8e319027 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Action: 'create', calling method: .version_select at 0x7f04d1dafaf0>, body: {"keypair": {"name": "tempest-keypair-481579894", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHoCpd5QhfmY108dBCgunyRe+TBWa/u0jRlV4ikOPRoQ6JkMkIWQ93WGNN5+R7DcwOFQm2CwsODsIXMizBAf7XvVbWJEG4Uso4QyPurpqO3R0gUKgHYa/bM3MY5bWfMYw=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:22:10.022786 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-520f3e31-d883-4eb0-8a0c-757b8e319027 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Getting quotas for project 0ca0b63bd9224370b45e7cc5e9c68a27. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:22:10.026906 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-520f3e31-d883-4eb0-8a0c-757b8e319027 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Getting quotas for user e22472efcb9a454688744457cb45eabb and project 0ca0b63bd9224370b45e7cc5e9c68a27. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:22:10.051199 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-520f3e31-d883-4eb0-8a0c-757b8e319027 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.099765 Sep 06 21:22:10.051816 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 462/915] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Sep 6 21:22:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:22:10.123919 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3b74b365-98e6-4ab5-9ecd-cb819fb48839 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:10.124546 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3b74b365-98e6-4ab5-9ecd-cb819fb48839 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:10.131895 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b74b365-98e6-4ab5-9ecd-cb819fb48839 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:10.132375 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b74b365-98e6-4ab5-9ecd-cb819fb48839 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:10.132859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b74b365-98e6-4ab5-9ecd-cb819fb48839 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:10.133504 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b74b365-98e6-4ab5-9ecd-cb819fb48839 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:10.133947 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b74b365-98e6-4ab5-9ecd-cb819fb48839 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:10.134354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b74b365-98e6-4ab5-9ecd-cb819fb48839 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:10.294523 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3b74b365-98e6-4ab5-9ecd-cb819fb48839 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:10.304512 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3b74b365-98e6-4ab5-9ecd-cb819fb48839 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1573 microversion: 2.1 time: 0.184667 Sep 06 21:22:10.305212 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 454/916] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:10 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1573 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:11.329547 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-01258d99-709d-4fdc-b860-c0857f3175cc tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:11.330415 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-01258d99-709d-4fdc-b860-c0857f3175cc tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:11.338021 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01258d99-709d-4fdc-b860-c0857f3175cc tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:11.338662 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01258d99-709d-4fdc-b860-c0857f3175cc tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:11.339322 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01258d99-709d-4fdc-b860-c0857f3175cc tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:11.340227 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01258d99-709d-4fdc-b860-c0857f3175cc tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:11.340688 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01258d99-709d-4fdc-b860-c0857f3175cc tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:11.341330 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-01258d99-709d-4fdc-b860-c0857f3175cc tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:11.365427 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-204fe957-4ee2-4b79-a1e1-9903384dfa6d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1542571683", "imageRef": "8b4a7612-517c-4711-8637-36b221338f65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1fbc3f3e-7fe7-459b-8f2b-1c8b1d601e7b"}], "security_groups": [{"name": "tempest-securitygroup--626364752"}], "key_name": "tempest-keypair-481579894", "user_data": "}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:22:11.484173 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-204fe957-4ee2-4b79-a1e1-9903384dfa6d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] validate_networks() for [('1fbc3f3e-7fe7-459b-8f2b-1c8b1d601e7b', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 21:22:11.495565 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-01258d99-709d-4fdc-b860-c0857f3175cc tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:11.498039 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:11.505474 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-01258d99-709d-4fdc-b860-c0857f3175cc tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1573 microversion: 2.1 time: 0.180815 Sep 06 21:22:11.506634 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 463/917] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:11 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1573 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:11.887272 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-204fe957-4ee2-4b79-a1e1-9903384dfa6d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 21:22:11.887694 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-204fe957-4ee2-4b79-a1e1-9903384dfa6d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 21:22:11.888283 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-204fe957-4ee2-4b79-a1e1-9903384dfa6d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 21:22:11.888734 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-204fe957-4ee2-4b79-a1e1-9903384dfa6d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 21:22:11.889158 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-204fe957-4ee2-4b79-a1e1-9903384dfa6d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 21:22:11.898869 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-204fe957-4ee2-4b79-a1e1-9903384dfa6d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:11.899347 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-204fe957-4ee2-4b79-a1e1-9903384dfa6d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:11.899774 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-204fe957-4ee2-4b79-a1e1-9903384dfa6d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:11.900522 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-204fe957-4ee2-4b79-a1e1-9903384dfa6d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:11.900990 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-204fe957-4ee2-4b79-a1e1-9903384dfa6d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:11.901467 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-204fe957-4ee2-4b79-a1e1-9903384dfa6d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:11.924274 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-204fe957-4ee2-4b79-a1e1-9903384dfa6d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Getting quotas for project 0ca0b63bd9224370b45e7cc5e9c68a27. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:22:11.928380 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-204fe957-4ee2-4b79-a1e1-9903384dfa6d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Getting quotas for user e22472efcb9a454688744457cb45eabb and project 0ca0b63bd9224370b45e7cc5e9c68a27. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:22:11.940111 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-204fe957-4ee2-4b79-a1e1-9903384dfa6d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 21:22:11.942452 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-204fe957-4ee2-4b79-a1e1-9903384dfa6d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8b4a7612-517c-4711-8637-36b221338f65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 21:22:11.994495 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-204fe957-4ee2-4b79-a1e1-9903384dfa6d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.633084 Sep 06 21:22:11.995474 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 455/918] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Sep 6 21:22:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 21:22:12.007071 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-58e15bc7-158a-47e5-9770-fc3327479bd6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:12.007685 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-58e15bc7-158a-47e5-9770-fc3327479bd6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:12.067630 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-58e15bc7-158a-47e5-9770-fc3327479bd6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:12.076454 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-58e15bc7-158a-47e5-9770-fc3327479bd6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3" status: 200 len: 1241 microversion: 2.1 time: 0.073543 Sep 06 21:22:12.077146 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 464/919] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:12 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:12.529733 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9d97ef36-162d-4d2f-ba61-ba554691747f tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:12.531127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9d97ef36-162d-4d2f-ba61-ba554691747f tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:12.539976 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d97ef36-162d-4d2f-ba61-ba554691747f tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:12.541056 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d97ef36-162d-4d2f-ba61-ba554691747f tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:12.541645 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d97ef36-162d-4d2f-ba61-ba554691747f tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:12.542671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d97ef36-162d-4d2f-ba61-ba554691747f tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:12.543885 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d97ef36-162d-4d2f-ba61-ba554691747f tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:12.545286 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d97ef36-162d-4d2f-ba61-ba554691747f tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:12.722723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9d97ef36-162d-4d2f-ba61-ba554691747f tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:12.731270 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9d97ef36-162d-4d2f-ba61-ba554691747f tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1573 microversion: 2.1 time: 0.205326 Sep 06 21:22:12.731994 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 456/920] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:12 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1573 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:13.104116 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a1a72014-ccad-4192-81e1-eebda6dc2ce0 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:13.105077 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a1a72014-ccad-4192-81e1-eebda6dc2ce0 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:13.115963 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1a72014-ccad-4192-81e1-eebda6dc2ce0 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:13.117036 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1a72014-ccad-4192-81e1-eebda6dc2ce0 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:13.117838 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1a72014-ccad-4192-81e1-eebda6dc2ce0 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:13.118899 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1a72014-ccad-4192-81e1-eebda6dc2ce0 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:13.119638 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1a72014-ccad-4192-81e1-eebda6dc2ce0 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:13.120256 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1a72014-ccad-4192-81e1-eebda6dc2ce0 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:13.193978 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a1a72014-ccad-4192-81e1-eebda6dc2ce0 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:13.202241 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a1a72014-ccad-4192-81e1-eebda6dc2ce0 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3" status: 200 len: 1293 microversion: 2.1 time: 0.104906 Sep 06 21:22:13.202806 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 465/921] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:13 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3 => generated 1293 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:13.756370 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3fae1b7c-9b5b-4b88-b370-00f99caf3dc0 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:13.757096 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3fae1b7c-9b5b-4b88-b370-00f99caf3dc0 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:13.765583 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fae1b7c-9b5b-4b88-b370-00f99caf3dc0 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:13.766074 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fae1b7c-9b5b-4b88-b370-00f99caf3dc0 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:13.766509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fae1b7c-9b5b-4b88-b370-00f99caf3dc0 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:13.767224 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fae1b7c-9b5b-4b88-b370-00f99caf3dc0 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:13.767707 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fae1b7c-9b5b-4b88-b370-00f99caf3dc0 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:13.768130 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fae1b7c-9b5b-4b88-b370-00f99caf3dc0 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:13.914834 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3fae1b7c-9b5b-4b88-b370-00f99caf3dc0 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:13.923421 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3fae1b7c-9b5b-4b88-b370-00f99caf3dc0 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1573 microversion: 2.1 time: 0.172051 Sep 06 21:22:13.923974 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 457/922] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:13 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1573 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:14.228484 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8cd91fc3-be9a-48f3-ba8a-620ccc297d99 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:14.229542 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8cd91fc3-be9a-48f3-ba8a-620ccc297d99 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:14.238029 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8cd91fc3-be9a-48f3-ba8a-620ccc297d99 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:14.238520 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8cd91fc3-be9a-48f3-ba8a-620ccc297d99 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:14.238951 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8cd91fc3-be9a-48f3-ba8a-620ccc297d99 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:14.239771 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8cd91fc3-be9a-48f3-ba8a-620ccc297d99 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:14.240276 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8cd91fc3-be9a-48f3-ba8a-620ccc297d99 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:14.240695 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8cd91fc3-be9a-48f3-ba8a-620ccc297d99 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:14.562200 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8cd91fc3-be9a-48f3-ba8a-620ccc297d99 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:14.570214 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8cd91fc3-be9a-48f3-ba8a-620ccc297d99 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3" status: 200 len: 1311 microversion: 2.1 time: 0.347547 Sep 06 21:22:14.570788 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 466/923] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:14 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3 => generated 1311 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:14.827616 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7fdf5f87-e924-42fd-af33-217ec9c5b373 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:14.831766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7fdf5f87-e924-42fd-af33-217ec9c5b373 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:14.839000 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fdf5f87-e924-42fd-af33-217ec9c5b373 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:14.839477 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fdf5f87-e924-42fd-af33-217ec9c5b373 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:14.839896 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fdf5f87-e924-42fd-af33-217ec9c5b373 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:14.840597 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fdf5f87-e924-42fd-af33-217ec9c5b373 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:14.841216 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fdf5f87-e924-42fd-af33-217ec9c5b373 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:14.841670 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fdf5f87-e924-42fd-af33-217ec9c5b373 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:14.873418 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7fdf5f87-e924-42fd-af33-217ec9c5b373 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051066 Sep 06 21:22:14.874307 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 458/924] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:22:14 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 06 21:22:14.943711 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-21987529-0c0a-4d69-a417-542e82e296be tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:14.944216 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-21987529-0c0a-4d69-a417-542e82e296be tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:14.947049 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fbe20319-51bc-4fec-a40c-4cc53efb5a7d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:14.947820 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fbe20319-51bc-4fec-a40c-4cc53efb5a7d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:14.951644 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21987529-0c0a-4d69-a417-542e82e296be tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:14.952134 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21987529-0c0a-4d69-a417-542e82e296be tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:14.952768 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21987529-0c0a-4d69-a417-542e82e296be tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:14.954020 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21987529-0c0a-4d69-a417-542e82e296be tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:14.954658 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21987529-0c0a-4d69-a417-542e82e296be tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:14.954784 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fbe20319-51bc-4fec-a40c-4cc53efb5a7d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:14.955226 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fbe20319-51bc-4fec-a40c-4cc53efb5a7d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:14.955389 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21987529-0c0a-4d69-a417-542e82e296be tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:14.956001 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fbe20319-51bc-4fec-a40c-4cc53efb5a7d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:14.956741 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fbe20319-51bc-4fec-a40c-4cc53efb5a7d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:14.957198 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fbe20319-51bc-4fec-a40c-4cc53efb5a7d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:14.957621 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fbe20319-51bc-4fec-a40c-4cc53efb5a7d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:14.988870 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-21987529-0c0a-4d69-a417-542e82e296be tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 21:22:15.093036 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-21987529-0c0a-4d69-a417-542e82e296be tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 204 len: 0 microversion: 2.1 time: 0.152327 Sep 06 21:22:15.093805 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 467/925] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Sep 6 21:22:14 2022] DELETE /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 21:22:15.104230 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-868efad8-7c68-4b71-8e26-011a1cfb463d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:15.105002 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-868efad8-7c68-4b71-8e26-011a1cfb463d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:15.113912 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-868efad8-7c68-4b71-8e26-011a1cfb463d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:15.113912 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-868efad8-7c68-4b71-8e26-011a1cfb463d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:15.114279 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-868efad8-7c68-4b71-8e26-011a1cfb463d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:15.115114 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-868efad8-7c68-4b71-8e26-011a1cfb463d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:15.115230 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-868efad8-7c68-4b71-8e26-011a1cfb463d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:15.115882 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-868efad8-7c68-4b71-8e26-011a1cfb463d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:15.117663 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fbe20319-51bc-4fec-a40c-4cc53efb5a7d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:15.126363 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fbe20319-51bc-4fec-a40c-4cc53efb5a7d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1573 microversion: 2.1 time: 0.183391 Sep 06 21:22:15.127347 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 459/926] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:14 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1573 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:22:15.337541 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-868efad8-7c68-4b71-8e26-011a1cfb463d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:15.345711 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-868efad8-7c68-4b71-8e26-011a1cfb463d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1672 microversion: 2.1 time: 0.247244 Sep 06 21:22:15.346303 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 468/927] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:15 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1672 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:15.597117 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8cf939e6-f473-485c-855e-79fd6995d701 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:15.597751 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8cf939e6-f473-485c-855e-79fd6995d701 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:15.604796 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8cf939e6-f473-485c-855e-79fd6995d701 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:15.605288 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8cf939e6-f473-485c-855e-79fd6995d701 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:15.605707 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8cf939e6-f473-485c-855e-79fd6995d701 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:15.606417 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8cf939e6-f473-485c-855e-79fd6995d701 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:15.607117 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8cf939e6-f473-485c-855e-79fd6995d701 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:15.607711 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8cf939e6-f473-485c-855e-79fd6995d701 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:15.754126 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8cf939e6-f473-485c-855e-79fd6995d701 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:15.764697 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8cf939e6-f473-485c-855e-79fd6995d701 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3" status: 200 len: 1366 microversion: 2.1 time: 0.174106 Sep 06 21:22:15.765295 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 460/928] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:15 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:16.153730 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ac2a0ce0-741f-4a92-8af5-da60001cd44d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:16.154381 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ac2a0ce0-741f-4a92-8af5-da60001cd44d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:16.160833 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac2a0ce0-741f-4a92-8af5-da60001cd44d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:16.161318 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac2a0ce0-741f-4a92-8af5-da60001cd44d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:16.161752 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac2a0ce0-741f-4a92-8af5-da60001cd44d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:16.162462 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac2a0ce0-741f-4a92-8af5-da60001cd44d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:16.162914 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac2a0ce0-741f-4a92-8af5-da60001cd44d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:16.163339 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac2a0ce0-741f-4a92-8af5-da60001cd44d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:16.369803 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ac2a0ce0-741f-4a92-8af5-da60001cd44d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:16.371577 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cef607ce-a134-42a3-9b11-cd7610aff884 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:16.372460 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cef607ce-a134-42a3-9b11-cd7610aff884 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:16.378317 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ac2a0ce0-741f-4a92-8af5-da60001cd44d tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1573 microversion: 2.1 time: 0.229177 Sep 06 21:22:16.378889 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 469/929] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:16 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1573 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:16.382244 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cef607ce-a134-42a3-9b11-cd7610aff884 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:16.382615 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cef607ce-a134-42a3-9b11-cd7610aff884 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:16.383057 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cef607ce-a134-42a3-9b11-cd7610aff884 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:16.383769 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cef607ce-a134-42a3-9b11-cd7610aff884 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:16.384377 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cef607ce-a134-42a3-9b11-cd7610aff884 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:16.385003 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cef607ce-a134-42a3-9b11-cd7610aff884 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:16.529095 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cef607ce-a134-42a3-9b11-cd7610aff884 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:16.536967 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cef607ce-a134-42a3-9b11-cd7610aff884 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1672 microversion: 2.1 time: 0.171100 Sep 06 21:22:16.537630 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 461/930] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:16 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1672 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:16.696038 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-9b84b19e-1930-4c01-88ac-bf09bd4ee30b req-7bf2f9b7-aedd-488e-9205-eab292890de2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84876df2-af4d-4824-a96b-039881a934d3", "tag": "af839687-7616-4ebc-b3b9-e1aa0070a80a"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:22:16.713551 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9b84b19e-1930-4c01-88ac-bf09bd4ee30b req-7bf2f9b7-aedd-488e-9205-eab292890de2 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:16.714374 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9b84b19e-1930-4c01-88ac-bf09bd4ee30b req-7bf2f9b7-aedd-488e-9205-eab292890de2 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:16.715747 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9b84b19e-1930-4c01-88ac-bf09bd4ee30b req-7bf2f9b7-aedd-488e-9205-eab292890de2 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:16.729493 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-9b84b19e-1930-4c01-88ac-bf09bd4ee30b req-7bf2f9b7-aedd-488e-9205-eab292890de2 service nova] Creating event network-changed:af839687-7616-4ebc-b3b9-e1aa0070a80a for instance 84876df2-af4d-4824-a96b-039881a934d3 on hv-cinder-74915 Sep 06 21:22:16.735492 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-9b84b19e-1930-4c01-88ac-bf09bd4ee30b req-7bf2f9b7-aedd-488e-9205-eab292890de2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044826 Sep 06 21:22:16.736296 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 470/931] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:22:16.788216 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cbbf9143-eaa4-42a2-8366-59e0bcae7573 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:16.789270 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cbbf9143-eaa4-42a2-8366-59e0bcae7573 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:16.795837 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cbbf9143-eaa4-42a2-8366-59e0bcae7573 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:16.796317 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cbbf9143-eaa4-42a2-8366-59e0bcae7573 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:16.796775 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cbbf9143-eaa4-42a2-8366-59e0bcae7573 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:16.797970 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cbbf9143-eaa4-42a2-8366-59e0bcae7573 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:16.798400 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cbbf9143-eaa4-42a2-8366-59e0bcae7573 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:16.799145 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cbbf9143-eaa4-42a2-8366-59e0bcae7573 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:17.043524 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cbbf9143-eaa4-42a2-8366-59e0bcae7573 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:17.051660 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cbbf9143-eaa4-42a2-8366-59e0bcae7573 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3" status: 200 len: 1366 microversion: 2.1 time: 0.268031 Sep 06 21:22:17.066159 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 462/932] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:16 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:17.403828 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cbb4bedf-2e25-4549-904b-2f587343fdd2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:17.404566 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cbb4bedf-2e25-4549-904b-2f587343fdd2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:17.411160 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbb4bedf-2e25-4549-904b-2f587343fdd2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:17.411642 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbb4bedf-2e25-4549-904b-2f587343fdd2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:17.412079 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbb4bedf-2e25-4549-904b-2f587343fdd2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:17.412821 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbb4bedf-2e25-4549-904b-2f587343fdd2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:17.413278 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbb4bedf-2e25-4549-904b-2f587343fdd2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:17.413701 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cbb4bedf-2e25-4549-904b-2f587343fdd2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:17.560924 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4fec89cc-61cd-4d7f-ad2f-9087cd44f2a6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:17.561641 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4fec89cc-61cd-4d7f-ad2f-9087cd44f2a6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:17.570448 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-cbb4bedf-2e25-4549-904b-2f587343fdd2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:17.576016 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fec89cc-61cd-4d7f-ad2f-9087cd44f2a6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:17.576759 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fec89cc-61cd-4d7f-ad2f-9087cd44f2a6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:17.577432 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fec89cc-61cd-4d7f-ad2f-9087cd44f2a6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:17.578350 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fec89cc-61cd-4d7f-ad2f-9087cd44f2a6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:17.579003 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fec89cc-61cd-4d7f-ad2f-9087cd44f2a6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:17.579620 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fec89cc-61cd-4d7f-ad2f-9087cd44f2a6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:17.589134 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cbb4bedf-2e25-4549-904b-2f587343fdd2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1573 microversion: 2.1 time: 0.190059 Sep 06 21:22:17.590555 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 471/933] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:17 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1573 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:17.610157 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:17.735207 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4fec89cc-61cd-4d7f-ad2f-9087cd44f2a6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:17.743636 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4fec89cc-61cd-4d7f-ad2f-9087cd44f2a6 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1605 microversion: 2.1 time: 0.187559 Sep 06 21:22:17.744290 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 463/934] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:17 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1605 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:17.802845 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-42c9815e-cedf-459a-af7c-fe5a4fb52e90 req-9109af5e-dbf6-4b04-92a3-20320090cc78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c787b30-603f-4b67-b10c-519b49f5e43f", "name": "network-vif-deleted", "tag": "69b5a869-9450-44f8-b04d-e9ee1b517313"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:22:17.812402 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-42c9815e-cedf-459a-af7c-fe5a4fb52e90 req-9109af5e-dbf6-4b04-92a3-20320090cc78 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:17.812895 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-42c9815e-cedf-459a-af7c-fe5a4fb52e90 req-9109af5e-dbf6-4b04-92a3-20320090cc78 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:17.813315 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-42c9815e-cedf-459a-af7c-fe5a4fb52e90 req-9109af5e-dbf6-4b04-92a3-20320090cc78 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:17.825495 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-42c9815e-cedf-459a-af7c-fe5a4fb52e90 req-9109af5e-dbf6-4b04-92a3-20320090cc78 service nova] Creating event network-vif-deleted:69b5a869-9450-44f8-b04d-e9ee1b517313 for instance 9c787b30-603f-4b67-b10c-519b49f5e43f on hv-cinder-74915 Sep 06 21:22:17.830500 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-42c9815e-cedf-459a-af7c-fe5a4fb52e90 req-9109af5e-dbf6-4b04-92a3-20320090cc78 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031297 Sep 06 21:22:17.831031 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 472/935] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:22:18.075771 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0b27e200-b510-47b9-b09f-a4b95273f8b2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:18.076375 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0b27e200-b510-47b9-b09f-a4b95273f8b2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:18.083013 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b27e200-b510-47b9-b09f-a4b95273f8b2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:18.083417 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b27e200-b510-47b9-b09f-a4b95273f8b2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:18.083854 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b27e200-b510-47b9-b09f-a4b95273f8b2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:18.084517 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b27e200-b510-47b9-b09f-a4b95273f8b2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:18.085004 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b27e200-b510-47b9-b09f-a4b95273f8b2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:18.085434 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b27e200-b510-47b9-b09f-a4b95273f8b2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:18.222053 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0b27e200-b510-47b9-b09f-a4b95273f8b2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:18.230967 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0b27e200-b510-47b9-b09f-a4b95273f8b2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3" status: 200 len: 1366 microversion: 2.1 time: 0.159093 Sep 06 21:22:18.244682 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 464/936] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:18 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:18.614074 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2b70f4cf-5fa0-44c4-bf79-435aea6f6bef tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:18.614776 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2b70f4cf-5fa0-44c4-bf79-435aea6f6bef tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:18.621528 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b70f4cf-5fa0-44c4-bf79-435aea6f6bef tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:18.622010 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b70f4cf-5fa0-44c4-bf79-435aea6f6bef tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:18.622500 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b70f4cf-5fa0-44c4-bf79-435aea6f6bef tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:18.623413 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b70f4cf-5fa0-44c4-bf79-435aea6f6bef tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:18.624694 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b70f4cf-5fa0-44c4-bf79-435aea6f6bef tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:18.625216 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b70f4cf-5fa0-44c4-bf79-435aea6f6bef tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:18.760598 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2b70f4cf-5fa0-44c4-bf79-435aea6f6bef tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:18.767549 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5e6f1b7e-9af0-4669-b48d-344f9d0838db tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:18.768811 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5e6f1b7e-9af0-4669-b48d-344f9d0838db tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:18.769580 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2b70f4cf-5fa0-44c4-bf79-435aea6f6bef tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1573 microversion: 2.1 time: 0.160353 Sep 06 21:22:18.770482 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 473/937] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:18 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:18.775897 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e6f1b7e-9af0-4669-b48d-344f9d0838db tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:18.776380 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e6f1b7e-9af0-4669-b48d-344f9d0838db tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:18.776880 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e6f1b7e-9af0-4669-b48d-344f9d0838db tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:18.777622 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e6f1b7e-9af0-4669-b48d-344f9d0838db tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:18.778065 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e6f1b7e-9af0-4669-b48d-344f9d0838db tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:18.778442 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e6f1b7e-9af0-4669-b48d-344f9d0838db tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:18.846833 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5e6f1b7e-9af0-4669-b48d-344f9d0838db tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:18.855585 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5e6f1b7e-9af0-4669-b48d-344f9d0838db tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1605 microversion: 2.1 time: 0.091798 Sep 06 21:22:18.860885 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 465/938] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:18 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1605 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:22:19.257032 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0ee31071-8c2f-433f-8fad-a8f25e80fadf tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:19.257840 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0ee31071-8c2f-433f-8fad-a8f25e80fadf tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:19.260354 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:19.267663 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ee31071-8c2f-433f-8fad-a8f25e80fadf tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:19.268326 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ee31071-8c2f-433f-8fad-a8f25e80fadf tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:19.268949 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ee31071-8c2f-433f-8fad-a8f25e80fadf tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:19.269878 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ee31071-8c2f-433f-8fad-a8f25e80fadf tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:19.270464 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ee31071-8c2f-433f-8fad-a8f25e80fadf tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:19.271029 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ee31071-8c2f-433f-8fad-a8f25e80fadf tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:19.416488 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0ee31071-8c2f-433f-8fad-a8f25e80fadf tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:19.425813 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0ee31071-8c2f-433f-8fad-a8f25e80fadf tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3" status: 200 len: 1366 microversion: 2.1 time: 0.174137 Sep 06 21:22:19.426361 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 474/939] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:19 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:19.793154 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a2163d08-22ea-4a79-9c1d-1f8eeca7cc73 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:19.793881 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a2163d08-22ea-4a79-9c1d-1f8eeca7cc73 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:19.801098 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2163d08-22ea-4a79-9c1d-1f8eeca7cc73 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:19.801585 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2163d08-22ea-4a79-9c1d-1f8eeca7cc73 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:19.802013 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2163d08-22ea-4a79-9c1d-1f8eeca7cc73 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:19.802707 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2163d08-22ea-4a79-9c1d-1f8eeca7cc73 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:19.803140 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2163d08-22ea-4a79-9c1d-1f8eeca7cc73 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:19.803684 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2163d08-22ea-4a79-9c1d-1f8eeca7cc73 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:19.880337 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c700d49f-42de-403f-b182-de2ad5ee5477 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:19.880970 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c700d49f-42de-403f-b182-de2ad5ee5477 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:19.888210 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c700d49f-42de-403f-b182-de2ad5ee5477 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:19.888715 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c700d49f-42de-403f-b182-de2ad5ee5477 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:19.889524 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c700d49f-42de-403f-b182-de2ad5ee5477 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:19.890631 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c700d49f-42de-403f-b182-de2ad5ee5477 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:19.891087 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c700d49f-42de-403f-b182-de2ad5ee5477 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:19.891574 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c700d49f-42de-403f-b182-de2ad5ee5477 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:19.937180 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c700d49f-42de-403f-b182-de2ad5ee5477 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:19.938009 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c700d49f-42de-403f-b182-de2ad5ee5477 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:19.938586 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c700d49f-42de-403f-b182-de2ad5ee5477 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:19.939336 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-c700d49f-42de-403f-b182-de2ad5ee5477 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lazy-loading 'fault' on Instance uuid 9c787b30-603f-4b67-b10c-519b49f5e43f {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:22:19.996019 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c700d49f-42de-403f-b182-de2ad5ee5477 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:20.004678 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c700d49f-42de-403f-b182-de2ad5ee5477 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 200 len: 1327 microversion: 2.1 time: 0.128989 Sep 06 21:22:20.005880 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 475/940] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:19 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 1327 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:22:20.039370 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a2163d08-22ea-4a79-9c1d-1f8eeca7cc73 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:20.048961 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a2163d08-22ea-4a79-9c1d-1f8eeca7cc73 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1573 microversion: 2.1 time: 0.259796 Sep 06 21:22:20.049919 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 466/941] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:19 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1573 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:20.071453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-4cfc8063-988b-4d6d-8873-35421294c288 req-5b29af82-03e0-44ff-a785-3fb74fe2efb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "340de6d7-883f-4c26-89b1-4f8536aa09e8", "name": "network-vif-plugged", "status": "completed", "tag": "e03713ad-150d-4e1c-af49-98c4a6fe49fe"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:22:20.082280 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4cfc8063-988b-4d6d-8873-35421294c288 req-5b29af82-03e0-44ff-a785-3fb74fe2efb7 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:20.082815 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4cfc8063-988b-4d6d-8873-35421294c288 req-5b29af82-03e0-44ff-a785-3fb74fe2efb7 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:20.083317 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4cfc8063-988b-4d6d-8873-35421294c288 req-5b29af82-03e0-44ff-a785-3fb74fe2efb7 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:20.097784 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-4cfc8063-988b-4d6d-8873-35421294c288 req-5b29af82-03e0-44ff-a785-3fb74fe2efb7 service nova] Creating event network-vif-plugged:e03713ad-150d-4e1c-af49-98c4a6fe49fe for instance 340de6d7-883f-4c26-89b1-4f8536aa09e8 on hv-cinder-74915 Sep 06 21:22:20.103596 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-4cfc8063-988b-4d6d-8873-35421294c288 req-5b29af82-03e0-44ff-a785-3fb74fe2efb7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037234 Sep 06 21:22:20.104191 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 476/942] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:22:20.458908 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-858e2ff0-0a48-46ad-a278-3726c57cd8a1 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:20.459851 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-858e2ff0-0a48-46ad-a278-3726c57cd8a1 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:20.468292 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-858e2ff0-0a48-46ad-a278-3726c57cd8a1 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:20.468802 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-858e2ff0-0a48-46ad-a278-3726c57cd8a1 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:20.469238 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-858e2ff0-0a48-46ad-a278-3726c57cd8a1 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:20.469935 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-858e2ff0-0a48-46ad-a278-3726c57cd8a1 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:20.470382 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-858e2ff0-0a48-46ad-a278-3726c57cd8a1 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:20.470800 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-858e2ff0-0a48-46ad-a278-3726c57cd8a1 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:20.637574 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-858e2ff0-0a48-46ad-a278-3726c57cd8a1 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:20.645558 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-858e2ff0-0a48-46ad-a278-3726c57cd8a1 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3" status: 200 len: 1366 microversion: 2.1 time: 0.192923 Sep 06 21:22:20.646118 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 467/943] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:20 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:21.031981 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cfdcdfdd-ee8d-4c51-9b8b-c4b10fb80739 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:21.032858 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cfdcdfdd-ee8d-4c51-9b8b-c4b10fb80739 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:21.042639 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfdcdfdd-ee8d-4c51-9b8b-c4b10fb80739 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:21.043330 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfdcdfdd-ee8d-4c51-9b8b-c4b10fb80739 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:21.043956 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfdcdfdd-ee8d-4c51-9b8b-c4b10fb80739 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:21.044999 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfdcdfdd-ee8d-4c51-9b8b-c4b10fb80739 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:21.045419 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfdcdfdd-ee8d-4c51-9b8b-c4b10fb80739 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:21.045866 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfdcdfdd-ee8d-4c51-9b8b-c4b10fb80739 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:21.061527 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-cfdcdfdd-ee8d-4c51-9b8b-c4b10fb80739 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] HTTP exception thrown: Instance 9c787b30-603f-4b67-b10c-519b49f5e43f could not be found. Sep 06 21:22:21.063140 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cfdcdfdd-ee8d-4c51-9b8b-c4b10fb80739 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Request method failure captured: Sep 06 21:22:21.063140 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f HTTP/1.1 Sep 06 21:22:21.063140 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:22:21.063140 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:22:21.063140 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:22:21.063140 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:22:21.063140 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:22:21.063140 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:22:21.063140 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:22:21.063140 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:22:21.063140 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7gTafI_ZNMS2FAUEWoF-hkQ1NQ4-6kC6In2Ck9OdfqZOtnvrvDD7dhGsmk2W3QbGfvfNZVU6qZoYrUJYpieQuq-m8E365J674SZI20-lpkR-mroCGcvWzA22TXD35YMK7_HcTbWB9CZ8e2l2_bjTrnJcxjq1n27NciSiCZArYWGf6g Sep 06 21:22:21.063140 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:22:21.063140 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:22:21.063140 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:22:21.063140 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:22:21.063140 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:22:21.063140 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:22:21.063140 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: cabcd82424984a0ba003e5324b505e54 Sep 06 21:22:21.063140 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeTestJSON-2036003716 Sep 06 21:22:21.063140 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:22:21.063140 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:22:21.064799 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cabcd82424984a0ba003e5324b505e54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cabcd82424984a0ba003e5324b505e54", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cabcd82424984a0ba003e5324b505e54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cabcd82424984a0ba003e5324b505e54"}]}] Sep 06 21:22:21.064799 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeTestJSON-2036003716 Sep 06 21:22:21.064799 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: cabcd82424984a0ba003e5324b505e54 Sep 06 21:22:21.064799 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2036003716 Sep 06 21:22:21.064799 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeTestJSON-2036003716-project Sep 06 21:22:21.064799 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:22:21.064799 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:22:21.064799 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: 64033668b9fd4ba48eef09bdc3fdf2ee Sep 06 21:22:21.064799 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeTestJSON-2036003716-project Sep 06 21:22:21.064799 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: > Sep 06 21:22:21.064799 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Instance 9c787b30-603f-4b67-b10c-519b49f5e43f could not be found. Sep 06 21:22:21.064799 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'id': '9c787b30-603f-4b67-b10c-519b49f5e43f'} Sep 06 21:22:21.065776 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:22:21.065776 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:22:21.065776 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:22:21.065776 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:22:21.065776 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:22:21.065776 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:22:21.065776 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:22:21.065776 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:22:21.065776 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:22:21.065776 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:22:21.065776 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c787b30-603f-4b67-b10c-519b49f5e43f could not be found. Sep 06 21:22:21.065776 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:22:21.065776 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:22:21.065776 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:22:21.065776 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:22:21.065776 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:22:21.065776 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:22:21.065776 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:22:21.065776 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:22:21.065776 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:22:21.067300 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:22:21.067300 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:22:21.067300 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:22:21.067300 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:22:21.067300 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:22:21.067300 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:22:21.067300 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:22:21.067300 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c787b30-603f-4b67-b10c-519b49f5e43f could not be found. Sep 06 21:22:21.067300 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:22:21.067300 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:22:21.067300 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:22:21.067300 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:22:21.067300 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:22:21.067300 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:22:21.067300 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:22:21.067300 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:22:21.067300 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c787b30-603f-4b67-b10c-519b49f5e43f could not be found. Sep 06 21:22:21.067300 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:22:21.068901 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cfdcdfdd-ee8d-4c51-9b8b-c4b10fb80739 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Returning 404 to user: Instance 9c787b30-603f-4b67-b10c-519b49f5e43f could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:22:21.068901 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cfdcdfdd-ee8d-4c51-9b8b-c4b10fb80739 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 404 len: 111 microversion: 2.1 time: 0.039868 Sep 06 21:22:21.068901 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 477/944] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:21 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:22:21.073366 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-031fe048-8aef-4d21-89ef-30ee1bf564ba tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '.version_select at 0x7f04ce4524c0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:21.074553 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f0a2751e-9207-4b7c-87b2-9b800ac67bf2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:21.075176 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f0a2751e-9207-4b7c-87b2-9b800ac67bf2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:21.081777 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:21.081971 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0a2751e-9207-4b7c-87b2-9b800ac67bf2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:21.082315 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0a2751e-9207-4b7c-87b2-9b800ac67bf2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:21.082752 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0a2751e-9207-4b7c-87b2-9b800ac67bf2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:21.083523 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0a2751e-9207-4b7c-87b2-9b800ac67bf2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:21.084073 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0a2751e-9207-4b7c-87b2-9b800ac67bf2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:21.084508 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f0a2751e-9207-4b7c-87b2-9b800ac67bf2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:21.094357 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-031fe048-8aef-4d21-89ef-30ee1bf564ba tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-143609311" status: 202 len: 0 microversion: 2.1 time: 0.024674 Sep 06 21:22:21.094901 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 468/945] 10.222.0.79 () {58 vars in 1218 bytes} [Tue Sep 6 21:22:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-143609311 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:22:21.219798 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f0a2751e-9207-4b7c-87b2-9b800ac67bf2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:21.227893 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f0a2751e-9207-4b7c-87b2-9b800ac67bf2 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1573 microversion: 2.1 time: 0.156960 Sep 06 21:22:21.228446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 478/946] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:21 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:21.670316 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2b65da19-6847-44a3-b435-e3aabe4de2fe tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:21.670930 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2b65da19-6847-44a3-b435-e3aabe4de2fe tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:21.678487 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b65da19-6847-44a3-b435-e3aabe4de2fe tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:21.678963 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b65da19-6847-44a3-b435-e3aabe4de2fe tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:21.679482 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b65da19-6847-44a3-b435-e3aabe4de2fe tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:21.680175 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b65da19-6847-44a3-b435-e3aabe4de2fe tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:21.680629 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b65da19-6847-44a3-b435-e3aabe4de2fe tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:21.681065 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b65da19-6847-44a3-b435-e3aabe4de2fe tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:21.764097 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8e4e1748-0a3d-456a-9434-8c20b0d0c95e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Action: 'create', calling method: .version_select at 0x7f04ce563a60>, body: {"keypair": {"name": "tempest-keypair-1720488113", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtpoZho6YKzzU1oT7qc5sHYMUOYklowtgSNdzMVOspqkWqhmY8y4zwztVjDVjFdlaw3bJ9HTPLDx/R1uaOYyLu2vLGFb7BT44jMrJx3chhBj5dm85gyoD4yOXZJDllbKg=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:22:21.780402 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-8e4e1748-0a3d-456a-9434-8c20b0d0c95e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Getting quotas for project cabcd82424984a0ba003e5324b505e54. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:22:21.784558 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-8e4e1748-0a3d-456a-9434-8c20b0d0c95e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Getting quotas for user 64033668b9fd4ba48eef09bdc3fdf2ee and project cabcd82424984a0ba003e5324b505e54. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:22:21.808227 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8e4e1748-0a3d-456a-9434-8c20b0d0c95e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048194 Sep 06 21:22:21.808837 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 479/947] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Sep 6 21:22:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 21:22:21.828808 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2b65da19-6847-44a3-b435-e3aabe4de2fe tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:21.837954 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2b65da19-6847-44a3-b435-e3aabe4de2fe tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3" status: 200 len: 1366 microversion: 2.1 time: 0.172859 Sep 06 21:22:21.838862 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 469/948] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:21 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:22.252291 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-883b9fb9-4207-4d3e-95b5-42f9282926fb tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:22.253026 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-883b9fb9-4207-4d3e-95b5-42f9282926fb tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:22.259448 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-883b9fb9-4207-4d3e-95b5-42f9282926fb tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:22.259935 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-883b9fb9-4207-4d3e-95b5-42f9282926fb tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:22.260371 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-883b9fb9-4207-4d3e-95b5-42f9282926fb tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:22.261193 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-883b9fb9-4207-4d3e-95b5-42f9282926fb tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:22.261647 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-883b9fb9-4207-4d3e-95b5-42f9282926fb tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:22.262106 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-883b9fb9-4207-4d3e-95b5-42f9282926fb tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:22.478474 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-883b9fb9-4207-4d3e-95b5-42f9282926fb tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:22.487056 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-883b9fb9-4207-4d3e-95b5-42f9282926fb tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1560 microversion: 2.1 time: 0.239314 Sep 06 21:22:22.487626 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 480/949] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:22 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1560 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:22.863738 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1535d5cb-63e3-4c53-a1fe-f57eed1ecfa6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:22.864346 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1535d5cb-63e3-4c53-a1fe-f57eed1ecfa6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:22.866283 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:22.867339 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:22.873728 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1535d5cb-63e3-4c53-a1fe-f57eed1ecfa6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:22.874209 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1535d5cb-63e3-4c53-a1fe-f57eed1ecfa6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:22.874642 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1535d5cb-63e3-4c53-a1fe-f57eed1ecfa6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:22.875340 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1535d5cb-63e3-4c53-a1fe-f57eed1ecfa6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:22.875778 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1535d5cb-63e3-4c53-a1fe-f57eed1ecfa6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:22.876183 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1535d5cb-63e3-4c53-a1fe-f57eed1ecfa6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:23.010730 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1535d5cb-63e3-4c53-a1fe-f57eed1ecfa6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:23.021849 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1535d5cb-63e3-4c53-a1fe-f57eed1ecfa6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3" status: 200 len: 1366 microversion: 2.1 time: 0.161738 Sep 06 21:22:23.022801 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 470/950] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:22 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:23.237808 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0ed4c57b-665e-489d-873d-d8299b200923 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1348145063", "imageRef": "8b4a7612-517c-4711-8637-36b221338f65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4895ef76-f62c-4485-86de-16d3ba8c928b"}], "security_groups": [{"name": "tempest-securitygroup--820982165"}], "key_name": "tempest-keypair-1720488113", "user_data": "}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:22:23.358224 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-0ed4c57b-665e-489d-873d-d8299b200923 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] validate_networks() for [('4895ef76-f62c-4485-86de-16d3ba8c928b', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 21:22:23.752475 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-0ed4c57b-665e-489d-873d-d8299b200923 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 21:22:23.752943 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-0ed4c57b-665e-489d-873d-d8299b200923 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 21:22:23.753421 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-0ed4c57b-665e-489d-873d-d8299b200923 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 21:22:23.753845 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-0ed4c57b-665e-489d-873d-d8299b200923 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 21:22:23.754267 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-0ed4c57b-665e-489d-873d-d8299b200923 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 21:22:23.763611 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ed4c57b-665e-489d-873d-d8299b200923 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:23.764115 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ed4c57b-665e-489d-873d-d8299b200923 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:23.764560 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ed4c57b-665e-489d-873d-d8299b200923 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:23.765326 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ed4c57b-665e-489d-873d-d8299b200923 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:23.765814 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ed4c57b-665e-489d-873d-d8299b200923 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:23.766240 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ed4c57b-665e-489d-873d-d8299b200923 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:23.783810 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-0ed4c57b-665e-489d-873d-d8299b200923 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Getting quotas for project cabcd82424984a0ba003e5324b505e54. Resources: {'ram', 'cores', 'instances'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:22:23.788131 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-0ed4c57b-665e-489d-873d-d8299b200923 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Getting quotas for user 64033668b9fd4ba48eef09bdc3fdf2ee and project cabcd82424984a0ba003e5324b505e54. Resources: {'ram', 'cores', 'instances'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:22:23.800481 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0ed4c57b-665e-489d-873d-d8299b200923 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 21:22:23.802801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0ed4c57b-665e-489d-873d-d8299b200923 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8b4a7612-517c-4711-8637-36b221338f65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 21:22:23.849639 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0ed4c57b-665e-489d-873d-d8299b200923 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.616104 Sep 06 21:22:23.850465 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 481/951] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Sep 6 21:22:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 21:22:23.861842 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0e04c363-df80-469d-846a-7a47ed768f80 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:23.862458 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0e04c363-df80-469d-846a-7a47ed768f80 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:23.927857 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0e04c363-df80-469d-846a-7a47ed768f80 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:23.935902 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0e04c363-df80-469d-846a-7a47ed768f80 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77" status: 200 len: 1238 microversion: 2.1 time: 0.077859 Sep 06 21:22:23.944266 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 471/952] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:23 2022] GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77 => generated 1238 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:24.027997 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-cb1efc42-4398-4b4f-a147-a64a5ead3b1c req-be49679b-3b56-4fd8-8351-307feec0291d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84876df2-af4d-4824-a96b-039881a934d3", "name": "network-vif-plugged", "status": "completed", "tag": "af839687-7616-4ebc-b3b9-e1aa0070a80a"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:22:24.041191 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-cb1efc42-4398-4b4f-a147-a64a5ead3b1c req-be49679b-3b56-4fd8-8351-307feec0291d service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:24.042191 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-cb1efc42-4398-4b4f-a147-a64a5ead3b1c req-be49679b-3b56-4fd8-8351-307feec0291d service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:24.042976 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-cb1efc42-4398-4b4f-a147-a64a5ead3b1c req-be49679b-3b56-4fd8-8351-307feec0291d service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:24.045855 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d751825f-3252-45f2-9375-6772f7c198f7 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:24.046642 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d751825f-3252-45f2-9375-6772f7c198f7 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:24.056755 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-cb1efc42-4398-4b4f-a147-a64a5ead3b1c req-be49679b-3b56-4fd8-8351-307feec0291d service nova] Creating event network-vif-plugged:af839687-7616-4ebc-b3b9-e1aa0070a80a for instance 84876df2-af4d-4824-a96b-039881a934d3 on hv-cinder-74915 Sep 06 21:22:24.063247 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-cb1efc42-4398-4b4f-a147-a64a5ead3b1c req-be49679b-3b56-4fd8-8351-307feec0291d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039274 Sep 06 21:22:24.066351 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d751825f-3252-45f2-9375-6772f7c198f7 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:24.066889 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d751825f-3252-45f2-9375-6772f7c198f7 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:24.067607 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 482/953] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:22:24.067736 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d751825f-3252-45f2-9375-6772f7c198f7 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:24.068212 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d751825f-3252-45f2-9375-6772f7c198f7 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:24.068593 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d751825f-3252-45f2-9375-6772f7c198f7 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:24.069119 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d751825f-3252-45f2-9375-6772f7c198f7 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:24.223736 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d751825f-3252-45f2-9375-6772f7c198f7 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:24.231786 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d751825f-3252-45f2-9375-6772f7c198f7 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3" status: 200 len: 1366 microversion: 2.1 time: 0.189993 Sep 06 21:22:24.237985 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 472/954] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:24 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:24.960835 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-52f6e23b-c645-42f1-90e2-9464a443e948 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:24.961524 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-52f6e23b-c645-42f1-90e2-9464a443e948 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:24.968004 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52f6e23b-c645-42f1-90e2-9464a443e948 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:24.968488 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52f6e23b-c645-42f1-90e2-9464a443e948 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:24.968946 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52f6e23b-c645-42f1-90e2-9464a443e948 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:24.969756 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52f6e23b-c645-42f1-90e2-9464a443e948 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:24.970214 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52f6e23b-c645-42f1-90e2-9464a443e948 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:24.970637 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52f6e23b-c645-42f1-90e2-9464a443e948 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:25.038889 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-52f6e23b-c645-42f1-90e2-9464a443e948 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:25.047197 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-52f6e23b-c645-42f1-90e2-9464a443e948 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77" status: 200 len: 1290 microversion: 2.1 time: 0.091508 Sep 06 21:22:25.048127 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 483/955] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:24 2022] GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77 => generated 1290 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:25.258897 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5a05cebb-fef1-4826-b0f7-98b9b515977c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:25.259962 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5a05cebb-fef1-4826-b0f7-98b9b515977c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:25.271118 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a05cebb-fef1-4826-b0f7-98b9b515977c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:25.271913 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a05cebb-fef1-4826-b0f7-98b9b515977c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:25.272619 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a05cebb-fef1-4826-b0f7-98b9b515977c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:25.273809 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a05cebb-fef1-4826-b0f7-98b9b515977c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:25.274545 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a05cebb-fef1-4826-b0f7-98b9b515977c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:25.275238 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a05cebb-fef1-4826-b0f7-98b9b515977c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:25.425174 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5a05cebb-fef1-4826-b0f7-98b9b515977c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:25.433699 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5a05cebb-fef1-4826-b0f7-98b9b515977c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3" status: 200 len: 1366 microversion: 2.1 time: 0.181309 Sep 06 21:22:25.434273 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 473/956] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:25 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:26.073582 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-681c46e1-8720-4176-8659-70ce03c51190 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:26.074230 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-681c46e1-8720-4176-8659-70ce03c51190 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:26.084536 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-681c46e1-8720-4176-8659-70ce03c51190 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:26.085173 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-681c46e1-8720-4176-8659-70ce03c51190 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:26.085598 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-681c46e1-8720-4176-8659-70ce03c51190 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:26.086751 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-681c46e1-8720-4176-8659-70ce03c51190 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:26.087515 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-681c46e1-8720-4176-8659-70ce03c51190 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:26.088069 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-681c46e1-8720-4176-8659-70ce03c51190 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:26.104728 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:26.159257 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-681c46e1-8720-4176-8659-70ce03c51190 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:26.168066 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-681c46e1-8720-4176-8659-70ce03c51190 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77" status: 200 len: 1290 microversion: 2.1 time: 0.100373 Sep 06 21:22:26.168770 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 484/957] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:26 2022] GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77 => generated 1290 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:26.457399 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bff823ec-48d1-44dc-8222-42c6b110db64 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:26.457971 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bff823ec-48d1-44dc-8222-42c6b110db64 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:26.465517 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bff823ec-48d1-44dc-8222-42c6b110db64 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:26.465999 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bff823ec-48d1-44dc-8222-42c6b110db64 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:26.466436 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bff823ec-48d1-44dc-8222-42c6b110db64 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:26.467143 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bff823ec-48d1-44dc-8222-42c6b110db64 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:26.467592 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bff823ec-48d1-44dc-8222-42c6b110db64 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:26.468007 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bff823ec-48d1-44dc-8222-42c6b110db64 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:26.614158 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bff823ec-48d1-44dc-8222-42c6b110db64 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:26.622093 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bff823ec-48d1-44dc-8222-42c6b110db64 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3" status: 200 len: 1556 microversion: 2.1 time: 0.168737 Sep 06 21:22:26.622658 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 474/958] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:26 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3 => generated 1556 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:26.646414 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a514934b-34a3-4fb7-99c9-553e5fd6b6a0 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:26.647004 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a514934b-34a3-4fb7-99c9-553e5fd6b6a0 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:26.656166 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a514934b-34a3-4fb7-99c9-553e5fd6b6a0 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:26.656822 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a514934b-34a3-4fb7-99c9-553e5fd6b6a0 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:26.657374 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a514934b-34a3-4fb7-99c9-553e5fd6b6a0 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:26.658142 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a514934b-34a3-4fb7-99c9-553e5fd6b6a0 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:26.658533 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a514934b-34a3-4fb7-99c9-553e5fd6b6a0 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:26.659068 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a514934b-34a3-4fb7-99c9-553e5fd6b6a0 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:26.741333 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a514934b-34a3-4fb7-99c9-553e5fd6b6a0 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099412 Sep 06 21:22:26.742062 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 485/959] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Sep 6 21:22:26 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:22:27.192058 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-930429f7-e774-435a-8ead-4b87e92cfe8c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:27.192863 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-930429f7-e774-435a-8ead-4b87e92cfe8c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:27.199331 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-930429f7-e774-435a-8ead-4b87e92cfe8c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:27.199779 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-930429f7-e774-435a-8ead-4b87e92cfe8c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:27.200403 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-930429f7-e774-435a-8ead-4b87e92cfe8c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:27.201348 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-930429f7-e774-435a-8ead-4b87e92cfe8c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:27.201956 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-930429f7-e774-435a-8ead-4b87e92cfe8c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:27.202375 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-930429f7-e774-435a-8ead-4b87e92cfe8c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:27.276457 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-930429f7-e774-435a-8ead-4b87e92cfe8c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:27.285221 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-930429f7-e774-435a-8ead-4b87e92cfe8c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77" status: 200 len: 1296 microversion: 2.1 time: 0.097311 Sep 06 21:22:27.285952 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 475/960] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:27 2022] GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77 => generated 1296 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:27.956690 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-dde702d2-f0d2-410e-859b-5797d85a22bd req-0cf958a9-539e-40e9-a0a7-de9531be0743 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84876df2-af4d-4824-a96b-039881a934d3", "tag": "af839687-7616-4ebc-b3b9-e1aa0070a80a"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:22:27.967776 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-dde702d2-f0d2-410e-859b-5797d85a22bd req-0cf958a9-539e-40e9-a0a7-de9531be0743 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:27.968305 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-dde702d2-f0d2-410e-859b-5797d85a22bd req-0cf958a9-539e-40e9-a0a7-de9531be0743 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:27.969171 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-dde702d2-f0d2-410e-859b-5797d85a22bd req-0cf958a9-539e-40e9-a0a7-de9531be0743 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:27.981281 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-dde702d2-f0d2-410e-859b-5797d85a22bd req-0cf958a9-539e-40e9-a0a7-de9531be0743 service nova] Creating event network-changed:af839687-7616-4ebc-b3b9-e1aa0070a80a for instance 84876df2-af4d-4824-a96b-039881a934d3 on hv-cinder-74915 Sep 06 21:22:27.987428 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-dde702d2-f0d2-410e-859b-5797d85a22bd req-0cf958a9-539e-40e9-a0a7-de9531be0743 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035112 Sep 06 21:22:27.991671 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 486/961] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:22:28.311017 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2176f67b-0c65-4f21-b6e2-71056e15a016 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:28.312846 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2176f67b-0c65-4f21-b6e2-71056e15a016 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:28.318247 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-43e22e4c-057f-4246-88ab-3ef988bad3d4 req-9d12a81f-16c1-4190-8bcf-b7ea3329cad8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c8fa97e-9971-4d57-8284-386f235d2a77", "tag": "6332044f-f818-4635-8a4a-75463270aecd"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:22:28.330941 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2176f67b-0c65-4f21-b6e2-71056e15a016 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:28.331735 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2176f67b-0c65-4f21-b6e2-71056e15a016 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:28.332403 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2176f67b-0c65-4f21-b6e2-71056e15a016 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:28.333593 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2176f67b-0c65-4f21-b6e2-71056e15a016 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:28.334572 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2176f67b-0c65-4f21-b6e2-71056e15a016 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:28.336391 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-43e22e4c-057f-4246-88ab-3ef988bad3d4 req-9d12a81f-16c1-4190-8bcf-b7ea3329cad8 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:28.337265 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2176f67b-0c65-4f21-b6e2-71056e15a016 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:28.338676 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-43e22e4c-057f-4246-88ab-3ef988bad3d4 req-9d12a81f-16c1-4190-8bcf-b7ea3329cad8 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:28.340211 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-43e22e4c-057f-4246-88ab-3ef988bad3d4 req-9d12a81f-16c1-4190-8bcf-b7ea3329cad8 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:28.377367 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-43e22e4c-057f-4246-88ab-3ef988bad3d4 req-9d12a81f-16c1-4190-8bcf-b7ea3329cad8 service nova] Creating event network-changed:6332044f-f818-4635-8a4a-75463270aecd for instance 7c8fa97e-9971-4d57-8284-386f235d2a77 on hv-cinder-74915 Sep 06 21:22:28.388028 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-43e22e4c-057f-4246-88ab-3ef988bad3d4 req-9d12a81f-16c1-4190-8bcf-b7ea3329cad8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079583 Sep 06 21:22:28.389275 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 487/962] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:22:28.590934 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2176f67b-0c65-4f21-b6e2-71056e15a016 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:28.601855 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2176f67b-0c65-4f21-b6e2-71056e15a016 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77" status: 200 len: 1363 microversion: 2.1 time: 0.295977 Sep 06 21:22:28.603614 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 476/963] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:28 2022] GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77 => generated 1363 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:29.627580 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-86711dc1-a86d-45e3-8b85-b8e7b54923c2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:29.628282 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-86711dc1-a86d-45e3-8b85-b8e7b54923c2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:29.635120 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86711dc1-a86d-45e3-8b85-b8e7b54923c2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:29.635575 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86711dc1-a86d-45e3-8b85-b8e7b54923c2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:29.635983 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86711dc1-a86d-45e3-8b85-b8e7b54923c2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:29.636680 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86711dc1-a86d-45e3-8b85-b8e7b54923c2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:29.637172 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86711dc1-a86d-45e3-8b85-b8e7b54923c2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:29.637594 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86711dc1-a86d-45e3-8b85-b8e7b54923c2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:29.770259 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-86711dc1-a86d-45e3-8b85-b8e7b54923c2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:29.778799 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-86711dc1-a86d-45e3-8b85-b8e7b54923c2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77" status: 200 len: 1363 microversion: 2.1 time: 0.156077 Sep 06 21:22:29.779448 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 488/964] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:29 2022] GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:30.806583 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c041cb34-cacb-4983-a191-f58136ca9988 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:30.807675 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c041cb34-cacb-4983-a191-f58136ca9988 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:30.820018 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c041cb34-cacb-4983-a191-f58136ca9988 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:30.820834 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c041cb34-cacb-4983-a191-f58136ca9988 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:30.821562 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c041cb34-cacb-4983-a191-f58136ca9988 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:30.822717 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c041cb34-cacb-4983-a191-f58136ca9988 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:30.823462 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c041cb34-cacb-4983-a191-f58136ca9988 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:30.824126 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c041cb34-cacb-4983-a191-f58136ca9988 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:30.971755 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c041cb34-cacb-4983-a191-f58136ca9988 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:30.980573 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c041cb34-cacb-4983-a191-f58136ca9988 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77" status: 200 len: 1363 microversion: 2.1 time: 0.180541 Sep 06 21:22:30.981245 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 477/965] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:30 2022] GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:32.003832 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1f4348d8-d5d3-4126-ba0b-b9113f16706d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:32.004406 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1f4348d8-d5d3-4126-ba0b-b9113f16706d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:32.011149 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f4348d8-d5d3-4126-ba0b-b9113f16706d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:32.011758 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f4348d8-d5d3-4126-ba0b-b9113f16706d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:32.012192 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f4348d8-d5d3-4126-ba0b-b9113f16706d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:32.012915 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f4348d8-d5d3-4126-ba0b-b9113f16706d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:32.013365 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f4348d8-d5d3-4126-ba0b-b9113f16706d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:32.013784 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f4348d8-d5d3-4126-ba0b-b9113f16706d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:32.149997 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1f4348d8-d5d3-4126-ba0b-b9113f16706d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:32.158039 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1f4348d8-d5d3-4126-ba0b-b9113f16706d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77" status: 200 len: 1363 microversion: 2.1 time: 0.158277 Sep 06 21:22:32.158625 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 489/966] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:31 2022] GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:33.185950 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ae97e074-466e-4eb3-92e8-6a0d063f2963 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:33.187121 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ae97e074-466e-4eb3-92e8-6a0d063f2963 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:33.195197 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae97e074-466e-4eb3-92e8-6a0d063f2963 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:33.195680 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae97e074-466e-4eb3-92e8-6a0d063f2963 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:33.196112 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae97e074-466e-4eb3-92e8-6a0d063f2963 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:33.196829 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae97e074-466e-4eb3-92e8-6a0d063f2963 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:33.197275 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae97e074-466e-4eb3-92e8-6a0d063f2963 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:33.197694 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae97e074-466e-4eb3-92e8-6a0d063f2963 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:33.333676 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ae97e074-466e-4eb3-92e8-6a0d063f2963 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:33.345752 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ae97e074-466e-4eb3-92e8-6a0d063f2963 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77" status: 200 len: 1363 microversion: 2.1 time: 0.167603 Sep 06 21:22:33.346698 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 478/967] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:33 2022] GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:34.374326 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a4615c52-799d-4e0c-87da-f58d6b7126f2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:34.375423 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a4615c52-799d-4e0c-87da-f58d6b7126f2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:34.379455 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:34.380578 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=16 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:34.390914 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a4615c52-799d-4e0c-87da-f58d6b7126f2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:34.391753 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a4615c52-799d-4e0c-87da-f58d6b7126f2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:34.392569 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a4615c52-799d-4e0c-87da-f58d6b7126f2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:34.393782 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a4615c52-799d-4e0c-87da-f58d6b7126f2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:34.394556 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a4615c52-799d-4e0c-87da-f58d6b7126f2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:34.395153 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a4615c52-799d-4e0c-87da-f58d6b7126f2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:34.538915 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a4615c52-799d-4e0c-87da-f58d6b7126f2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:34.550171 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a4615c52-799d-4e0c-87da-f58d6b7126f2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77" status: 200 len: 1363 microversion: 2.1 time: 0.182197 Sep 06 21:22:34.550968 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 490/968] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:34 2022] GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:35.575003 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-290dc177-0932-4f4e-ae77-e04738d52dcf tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:35.575996 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-290dc177-0932-4f4e-ae77-e04738d52dcf tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:35.579062 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:35.588624 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-290dc177-0932-4f4e-ae77-e04738d52dcf tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:35.589468 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-290dc177-0932-4f4e-ae77-e04738d52dcf tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:35.590190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-290dc177-0932-4f4e-ae77-e04738d52dcf tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:35.591347 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-290dc177-0932-4f4e-ae77-e04738d52dcf tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:35.592057 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-290dc177-0932-4f4e-ae77-e04738d52dcf tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:35.592956 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-290dc177-0932-4f4e-ae77-e04738d52dcf tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:35.736968 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-290dc177-0932-4f4e-ae77-e04738d52dcf tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:35.745023 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-290dc177-0932-4f4e-ae77-e04738d52dcf tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77" status: 200 len: 1363 microversion: 2.1 time: 0.174710 Sep 06 21:22:35.745587 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 479/969] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:35 2022] GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:36.085704 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-881237de-0ad2-4876-a0fb-48abca714a25 req-14fae51a-5ef8-4faf-ab4f-cb53ebc875e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c8fa97e-9971-4d57-8284-386f235d2a77", "name": "network-vif-plugged", "status": "completed", "tag": "6332044f-f818-4635-8a4a-75463270aecd"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:22:36.096132 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-881237de-0ad2-4876-a0fb-48abca714a25 req-14fae51a-5ef8-4faf-ab4f-cb53ebc875e6 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:36.096639 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-881237de-0ad2-4876-a0fb-48abca714a25 req-14fae51a-5ef8-4faf-ab4f-cb53ebc875e6 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:36.097075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-881237de-0ad2-4876-a0fb-48abca714a25 req-14fae51a-5ef8-4faf-ab4f-cb53ebc875e6 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:36.108789 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-881237de-0ad2-4876-a0fb-48abca714a25 req-14fae51a-5ef8-4faf-ab4f-cb53ebc875e6 service nova] Creating event network-vif-plugged:6332044f-f818-4635-8a4a-75463270aecd for instance 7c8fa97e-9971-4d57-8284-386f235d2a77 on hv-cinder-74915 Sep 06 21:22:36.113908 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-881237de-0ad2-4876-a0fb-48abca714a25 req-14fae51a-5ef8-4faf-ab4f-cb53ebc875e6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032051 Sep 06 21:22:36.115129 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 491/970] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:22:36.780358 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6705e774-a691-4681-a482-b8499ac04305 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:36.781091 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6705e774-a691-4681-a482-b8499ac04305 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:36.792440 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6705e774-a691-4681-a482-b8499ac04305 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:36.792647 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6705e774-a691-4681-a482-b8499ac04305 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:36.793231 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6705e774-a691-4681-a482-b8499ac04305 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:36.794374 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6705e774-a691-4681-a482-b8499ac04305 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:36.795075 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6705e774-a691-4681-a482-b8499ac04305 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:36.796165 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6705e774-a691-4681-a482-b8499ac04305 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:36.928239 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6705e774-a691-4681-a482-b8499ac04305 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:36.936151 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6705e774-a691-4681-a482-b8499ac04305 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77" status: 200 len: 1363 microversion: 2.1 time: 0.162068 Sep 06 21:22:36.936725 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 480/971] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:36 2022] GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:37.962558 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b9349b6a-3b14-4bdd-b302-a6fb1f8ba86a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:37.963323 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b9349b6a-3b14-4bdd-b302-a6fb1f8ba86a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:37.969831 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9349b6a-3b14-4bdd-b302-a6fb1f8ba86a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:37.970323 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9349b6a-3b14-4bdd-b302-a6fb1f8ba86a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:37.970763 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9349b6a-3b14-4bdd-b302-a6fb1f8ba86a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:37.971477 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9349b6a-3b14-4bdd-b302-a6fb1f8ba86a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:37.971931 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9349b6a-3b14-4bdd-b302-a6fb1f8ba86a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:37.972360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b9349b6a-3b14-4bdd-b302-a6fb1f8ba86a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:38.118855 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b9349b6a-3b14-4bdd-b302-a6fb1f8ba86a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:38.127134 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b9349b6a-3b14-4bdd-b302-a6fb1f8ba86a tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77" status: 200 len: 1363 microversion: 2.1 time: 0.170535 Sep 06 21:22:38.127716 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 492/972] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:37 2022] GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:39.153757 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7ef5b3a9-713e-4359-a508-518201e6f2fa tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:39.154655 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7ef5b3a9-713e-4359-a508-518201e6f2fa tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:39.164399 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ef5b3a9-713e-4359-a508-518201e6f2fa tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:39.164922 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ef5b3a9-713e-4359-a508-518201e6f2fa tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:39.165354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ef5b3a9-713e-4359-a508-518201e6f2fa tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:39.166084 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ef5b3a9-713e-4359-a508-518201e6f2fa tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:39.166531 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ef5b3a9-713e-4359-a508-518201e6f2fa tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:39.166964 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ef5b3a9-713e-4359-a508-518201e6f2fa tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:39.304305 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7ef5b3a9-713e-4359-a508-518201e6f2fa tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:22:39.317979 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7ef5b3a9-713e-4359-a508-518201e6f2fa tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77" status: 200 len: 1549 microversion: 2.1 time: 0.169789 Sep 06 21:22:39.318875 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 481/973] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:22:39 2022] GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77 => generated 1549 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:22:39.343896 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6218e0ac-7734-4b2a-83da-c12c2566ccf9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:22:39.344448 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6218e0ac-7734-4b2a-83da-c12c2566ccf9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:22:39.353621 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6218e0ac-7734-4b2a-83da-c12c2566ccf9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:39.353772 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6218e0ac-7734-4b2a-83da-c12c2566ccf9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:39.354160 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6218e0ac-7734-4b2a-83da-c12c2566ccf9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:39.354849 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6218e0ac-7734-4b2a-83da-c12c2566ccf9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:39.355294 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6218e0ac-7734-4b2a-83da-c12c2566ccf9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:39.355713 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6218e0ac-7734-4b2a-83da-c12c2566ccf9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:39.441189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6218e0ac-7734-4b2a-83da-c12c2566ccf9 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103260 Sep 06 21:22:39.442010 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 493/974] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Sep 6 21:22:39 2022] GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:22:40.418693 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-7f853754-b5ed-436d-9aa0-7250073affa5 req-78001ed4-6024-45f9-8bcb-1164c49cd9d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c8fa97e-9971-4d57-8284-386f235d2a77", "tag": "6332044f-f818-4635-8a4a-75463270aecd"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:22:40.430017 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7f853754-b5ed-436d-9aa0-7250073affa5 req-78001ed4-6024-45f9-8bcb-1164c49cd9d2 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:22:40.430483 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7f853754-b5ed-436d-9aa0-7250073affa5 req-78001ed4-6024-45f9-8bcb-1164c49cd9d2 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:22:40.430909 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7f853754-b5ed-436d-9aa0-7250073affa5 req-78001ed4-6024-45f9-8bcb-1164c49cd9d2 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:22:40.434985 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:40.443528 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-7f853754-b5ed-436d-9aa0-7250073affa5 req-78001ed4-6024-45f9-8bcb-1164c49cd9d2 service nova] Creating event network-changed:6332044f-f818-4635-8a4a-75463270aecd for instance 7c8fa97e-9971-4d57-8284-386f235d2a77 on hv-cinder-74915 Sep 06 21:22:40.449748 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-7f853754-b5ed-436d-9aa0-7250073affa5 req-78001ed4-6024-45f9-8bcb-1164c49cd9d2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034408 Sep 06 21:22:40.450349 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 482/975] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:23:04.132117 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:04.133047 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=41 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:04.139465 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-45a2eb98-363a-45a1-a1d8-1559e89dc4aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:04.140447 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-45a2eb98-363a-45a1-a1d8-1559e89dc4aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:04.150658 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-45a2eb98-363a-45a1-a1d8-1559e89dc4aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:04.151227 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-45a2eb98-363a-45a1-a1d8-1559e89dc4aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:04.151741 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-45a2eb98-363a-45a1-a1d8-1559e89dc4aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:04.152548 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-45a2eb98-363a-45a1-a1d8-1559e89dc4aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:04.153119 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-45a2eb98-363a-45a1-a1d8-1559e89dc4aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:04.153656 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-45a2eb98-363a-45a1-a1d8-1559e89dc4aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:04.179523 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-45a2eb98-363a-45a1-a1d8-1559e89dc4aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e/ips" status: 200 len: 152 microversion: 2.20 time: 0.049155 Sep 06 21:23:04.180077 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 494/976] 10.222.0.79 () {60 vars in 1289 bytes} [Tue Sep 6 21:23:04 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e/ips => generated 152 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 21:23:07.043627 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-495a4d32-e63f-4793-a514-b99c8d2d6b4e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:23:07.044207 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-495a4d32-e63f-4793-a514-b99c8d2d6b4e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:07.046798 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:07.053185 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-495a4d32-e63f-4793-a514-b99c8d2d6b4e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:07.053662 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-495a4d32-e63f-4793-a514-b99c8d2d6b4e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:07.054098 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-495a4d32-e63f-4793-a514-b99c8d2d6b4e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:07.054817 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-495a4d32-e63f-4793-a514-b99c8d2d6b4e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:07.055249 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-495a4d32-e63f-4793-a514-b99c8d2d6b4e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:07.055736 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-495a4d32-e63f-4793-a514-b99c8d2d6b4e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:07.081857 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-495a4d32-e63f-4793-a514-b99c8d2d6b4e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lazy-loading 'flavor' on Instance uuid 8066f708-d355-454f-b0fd-7b33e51e265e {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:23:07.294669 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-495a4d32-e63f-4793-a514-b99c8d2d6b4e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "POST /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e/action" status: 202 len: 0 microversion: 2.20 time: 0.255373 Sep 06 21:23:07.295347 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 483/977] 10.222.0.79 () {62 vars in 1319 bytes} [Tue Sep 6 21:23:07 2022] POST /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 21:23:07.304279 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c3a9ead0-cd77-4a12-89b5-cfd171267688 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:07.304894 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c3a9ead0-cd77-4a12-89b5-cfd171267688 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:07.311702 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3a9ead0-cd77-4a12-89b5-cfd171267688 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:07.312232 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3a9ead0-cd77-4a12-89b5-cfd171267688 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:07.312717 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3a9ead0-cd77-4a12-89b5-cfd171267688 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:07.313551 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3a9ead0-cd77-4a12-89b5-cfd171267688 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:07.314027 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3a9ead0-cd77-4a12-89b5-cfd171267688 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:07.314573 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3a9ead0-cd77-4a12-89b5-cfd171267688 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:07.466967 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c3a9ead0-cd77-4a12-89b5-cfd171267688 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:07.480062 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c3a9ead0-cd77-4a12-89b5-cfd171267688 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:07.482299 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c3a9ead0-cd77-4a12-89b5-cfd171267688 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:07.484123 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c3a9ead0-cd77-4a12-89b5-cfd171267688 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1724 microversion: 2.20 time: 0.183735 Sep 06 21:23:07.484893 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 495/978] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:07 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:08.516451 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4fa359da-05ef-4abf-a373-aa692dce9875 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:08.517688 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4fa359da-05ef-4abf-a373-aa692dce9875 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:08.528442 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fa359da-05ef-4abf-a373-aa692dce9875 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:08.529296 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fa359da-05ef-4abf-a373-aa692dce9875 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:08.530016 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fa359da-05ef-4abf-a373-aa692dce9875 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:08.531153 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fa359da-05ef-4abf-a373-aa692dce9875 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:08.531896 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fa359da-05ef-4abf-a373-aa692dce9875 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:08.532589 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fa359da-05ef-4abf-a373-aa692dce9875 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:08.676155 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4fa359da-05ef-4abf-a373-aa692dce9875 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:08.685321 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4fa359da-05ef-4abf-a373-aa692dce9875 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:08.686760 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4fa359da-05ef-4abf-a373-aa692dce9875 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:08.687966 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4fa359da-05ef-4abf-a373-aa692dce9875 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1724 microversion: 2.20 time: 0.179588 Sep 06 21:23:08.688527 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 484/979] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:08 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:09.718042 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-24000520-b24d-46b7-b1cf-4359eb5e1106 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:09.719005 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-24000520-b24d-46b7-b1cf-4359eb5e1106 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:09.730208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24000520-b24d-46b7-b1cf-4359eb5e1106 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:09.730997 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24000520-b24d-46b7-b1cf-4359eb5e1106 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:09.731708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24000520-b24d-46b7-b1cf-4359eb5e1106 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:09.732914 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24000520-b24d-46b7-b1cf-4359eb5e1106 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:09.733657 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24000520-b24d-46b7-b1cf-4359eb5e1106 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:09.734363 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24000520-b24d-46b7-b1cf-4359eb5e1106 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:09.876412 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-24000520-b24d-46b7-b1cf-4359eb5e1106 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:09.886305 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-24000520-b24d-46b7-b1cf-4359eb5e1106 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:09.887735 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-24000520-b24d-46b7-b1cf-4359eb5e1106 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:09.888960 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-24000520-b24d-46b7-b1cf-4359eb5e1106 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1724 microversion: 2.20 time: 0.177502 Sep 06 21:23:09.889518 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 496/980] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:09 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:10.919259 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-62af8915-e4e4-42ff-b382-272929a3e60d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:10.920296 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-62af8915-e4e4-42ff-b382-272929a3e60d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:10.931570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62af8915-e4e4-42ff-b382-272929a3e60d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:10.932351 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62af8915-e4e4-42ff-b382-272929a3e60d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:10.933118 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62af8915-e4e4-42ff-b382-272929a3e60d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:10.934237 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62af8915-e4e4-42ff-b382-272929a3e60d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:10.934986 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62af8915-e4e4-42ff-b382-272929a3e60d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:10.935671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62af8915-e4e4-42ff-b382-272929a3e60d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:11.074013 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-62af8915-e4e4-42ff-b382-272929a3e60d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:11.084355 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-62af8915-e4e4-42ff-b382-272929a3e60d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:11.085817 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-62af8915-e4e4-42ff-b382-272929a3e60d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:11.086966 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-62af8915-e4e4-42ff-b382-272929a3e60d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1724 microversion: 2.20 time: 0.174606 Sep 06 21:23:11.087510 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 485/981] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:10 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:12.117128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2fc113ff-e75d-4a71-a193-3cf813041bae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:12.117835 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2fc113ff-e75d-4a71-a193-3cf813041bae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:12.126159 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fc113ff-e75d-4a71-a193-3cf813041bae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:12.126767 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fc113ff-e75d-4a71-a193-3cf813041bae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:12.127394 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fc113ff-e75d-4a71-a193-3cf813041bae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:12.128275 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fc113ff-e75d-4a71-a193-3cf813041bae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:12.128910 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fc113ff-e75d-4a71-a193-3cf813041bae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:12.129442 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fc113ff-e75d-4a71-a193-3cf813041bae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:12.273353 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2fc113ff-e75d-4a71-a193-3cf813041bae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:12.281877 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2fc113ff-e75d-4a71-a193-3cf813041bae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:12.283373 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2fc113ff-e75d-4a71-a193-3cf813041bae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:12.284570 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2fc113ff-e75d-4a71-a193-3cf813041bae tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1724 microversion: 2.20 time: 0.172746 Sep 06 21:23:12.285380 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 497/982] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:12 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:13.315647 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-855e79a5-7393-4424-8975-50a174debe9f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:13.316899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-855e79a5-7393-4424-8975-50a174debe9f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:13.328358 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-855e79a5-7393-4424-8975-50a174debe9f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:13.329204 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-855e79a5-7393-4424-8975-50a174debe9f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:13.329926 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-855e79a5-7393-4424-8975-50a174debe9f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:13.330784 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-855e79a5-7393-4424-8975-50a174debe9f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:13.331239 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-855e79a5-7393-4424-8975-50a174debe9f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:13.331664 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-855e79a5-7393-4424-8975-50a174debe9f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:13.476963 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-855e79a5-7393-4424-8975-50a174debe9f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:13.486065 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-855e79a5-7393-4424-8975-50a174debe9f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:13.487564 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-855e79a5-7393-4424-8975-50a174debe9f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:13.488735 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-855e79a5-7393-4424-8975-50a174debe9f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1724 microversion: 2.20 time: 0.180352 Sep 06 21:23:13.489340 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 486/983] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:13 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:14.515970 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d8a72cbb-f0f4-4bed-9e2e-cdd34ae327ca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:14.516607 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d8a72cbb-f0f4-4bed-9e2e-cdd34ae327ca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:14.525215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8a72cbb-f0f4-4bed-9e2e-cdd34ae327ca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:14.525751 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8a72cbb-f0f4-4bed-9e2e-cdd34ae327ca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:14.526244 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8a72cbb-f0f4-4bed-9e2e-cdd34ae327ca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:14.527069 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8a72cbb-f0f4-4bed-9e2e-cdd34ae327ca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:14.527595 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8a72cbb-f0f4-4bed-9e2e-cdd34ae327ca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:14.527989 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d8a72cbb-f0f4-4bed-9e2e-cdd34ae327ca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:14.668494 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d8a72cbb-f0f4-4bed-9e2e-cdd34ae327ca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:14.677639 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d8a72cbb-f0f4-4bed-9e2e-cdd34ae327ca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:14.679086 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d8a72cbb-f0f4-4bed-9e2e-cdd34ae327ca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:14.680240 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d8a72cbb-f0f4-4bed-9e2e-cdd34ae327ca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1724 microversion: 2.20 time: 0.169121 Sep 06 21:23:14.680785 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 498/984] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:14 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:15.708051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6334bce3-dbce-4caf-86a8-35ebf51145ed tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:15.708693 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6334bce3-dbce-4caf-86a8-35ebf51145ed tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:15.715941 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6334bce3-dbce-4caf-86a8-35ebf51145ed tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:15.716451 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6334bce3-dbce-4caf-86a8-35ebf51145ed tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:15.716902 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6334bce3-dbce-4caf-86a8-35ebf51145ed tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:15.717599 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6334bce3-dbce-4caf-86a8-35ebf51145ed tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:15.718051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6334bce3-dbce-4caf-86a8-35ebf51145ed tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:15.718479 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6334bce3-dbce-4caf-86a8-35ebf51145ed tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:15.853752 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6334bce3-dbce-4caf-86a8-35ebf51145ed tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:15.862305 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6334bce3-dbce-4caf-86a8-35ebf51145ed tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:15.863734 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6334bce3-dbce-4caf-86a8-35ebf51145ed tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:15.864925 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6334bce3-dbce-4caf-86a8-35ebf51145ed tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1724 microversion: 2.20 time: 0.161987 Sep 06 21:23:15.865486 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 487/985] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:15 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:16.896034 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3cf26a29-39c2-41b9-976e-5d297817d5dd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:16.897052 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3cf26a29-39c2-41b9-976e-5d297817d5dd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:16.908884 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cf26a29-39c2-41b9-976e-5d297817d5dd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:16.909376 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cf26a29-39c2-41b9-976e-5d297817d5dd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:16.909813 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cf26a29-39c2-41b9-976e-5d297817d5dd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:16.910517 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cf26a29-39c2-41b9-976e-5d297817d5dd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:16.910973 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cf26a29-39c2-41b9-976e-5d297817d5dd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:16.911398 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3cf26a29-39c2-41b9-976e-5d297817d5dd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:17.058374 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3cf26a29-39c2-41b9-976e-5d297817d5dd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:17.067211 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3cf26a29-39c2-41b9-976e-5d297817d5dd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:17.068687 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3cf26a29-39c2-41b9-976e-5d297817d5dd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:17.069884 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3cf26a29-39c2-41b9-976e-5d297817d5dd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1724 microversion: 2.20 time: 0.181107 Sep 06 21:23:17.070449 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 499/986] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:16 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:18.099701 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-03468e34-f462-4097-a985-70a6a1997b36 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:18.100336 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-03468e34-f462-4097-a985-70a6a1997b36 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:18.108774 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03468e34-f462-4097-a985-70a6a1997b36 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:18.109264 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03468e34-f462-4097-a985-70a6a1997b36 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:18.109693 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03468e34-f462-4097-a985-70a6a1997b36 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:18.110395 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03468e34-f462-4097-a985-70a6a1997b36 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:18.110845 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03468e34-f462-4097-a985-70a6a1997b36 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:18.111264 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03468e34-f462-4097-a985-70a6a1997b36 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:18.253939 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-03468e34-f462-4097-a985-70a6a1997b36 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:18.262665 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-03468e34-f462-4097-a985-70a6a1997b36 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:18.264089 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-03468e34-f462-4097-a985-70a6a1997b36 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:18.265275 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-03468e34-f462-4097-a985-70a6a1997b36 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1724 microversion: 2.20 time: 0.169563 Sep 06 21:23:18.265831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 488/987] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:18 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:19.293070 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0417480e-bcfa-46f5-98da-4b2c75594e28 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:19.293823 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0417480e-bcfa-46f5-98da-4b2c75594e28 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:19.302348 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0417480e-bcfa-46f5-98da-4b2c75594e28 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:19.302831 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0417480e-bcfa-46f5-98da-4b2c75594e28 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:19.303409 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0417480e-bcfa-46f5-98da-4b2c75594e28 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:19.304117 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0417480e-bcfa-46f5-98da-4b2c75594e28 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:19.304550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0417480e-bcfa-46f5-98da-4b2c75594e28 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:19.305028 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0417480e-bcfa-46f5-98da-4b2c75594e28 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:19.460959 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0417480e-bcfa-46f5-98da-4b2c75594e28 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:19.470221 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0417480e-bcfa-46f5-98da-4b2c75594e28 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:19.471637 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0417480e-bcfa-46f5-98da-4b2c75594e28 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:19.472832 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0417480e-bcfa-46f5-98da-4b2c75594e28 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1724 microversion: 2.20 time: 0.184876 Sep 06 21:23:19.473399 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 500/988] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:19 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:20.502290 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2ec9b010-2bd5-4a9b-a5f0-7c3fe2a037bb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:20.503240 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2ec9b010-2bd5-4a9b-a5f0-7c3fe2a037bb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:20.510188 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ec9b010-2bd5-4a9b-a5f0-7c3fe2a037bb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:20.510676 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ec9b010-2bd5-4a9b-a5f0-7c3fe2a037bb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:20.511110 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ec9b010-2bd5-4a9b-a5f0-7c3fe2a037bb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:20.511818 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ec9b010-2bd5-4a9b-a5f0-7c3fe2a037bb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:20.512270 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ec9b010-2bd5-4a9b-a5f0-7c3fe2a037bb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:20.512684 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ec9b010-2bd5-4a9b-a5f0-7c3fe2a037bb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:20.647975 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2ec9b010-2bd5-4a9b-a5f0-7c3fe2a037bb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:20.659942 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2ec9b010-2bd5-4a9b-a5f0-7c3fe2a037bb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:20.661411 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2ec9b010-2bd5-4a9b-a5f0-7c3fe2a037bb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:20.662552 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2ec9b010-2bd5-4a9b-a5f0-7c3fe2a037bb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1724 microversion: 2.20 time: 0.166850 Sep 06 21:23:20.663099 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 489/989] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:20 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:21.691167 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cfaa3731-be7f-42d0-9c0c-3141c5f88fcb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:21.692063 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cfaa3731-be7f-42d0-9c0c-3141c5f88fcb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:21.702616 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfaa3731-be7f-42d0-9c0c-3141c5f88fcb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:21.703330 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfaa3731-be7f-42d0-9c0c-3141c5f88fcb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:21.703988 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfaa3731-be7f-42d0-9c0c-3141c5f88fcb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:21.705116 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfaa3731-be7f-42d0-9c0c-3141c5f88fcb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:21.705839 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfaa3731-be7f-42d0-9c0c-3141c5f88fcb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:21.706291 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfaa3731-be7f-42d0-9c0c-3141c5f88fcb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:21.854244 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-cfaa3731-be7f-42d0-9c0c-3141c5f88fcb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:21.864081 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-cfaa3731-be7f-42d0-9c0c-3141c5f88fcb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:21.865652 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-cfaa3731-be7f-42d0-9c0c-3141c5f88fcb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:21.866951 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cfaa3731-be7f-42d0-9c0c-3141c5f88fcb tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1724 microversion: 2.20 time: 0.181926 Sep 06 21:23:21.867608 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 501/990] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:21 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:22.893292 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fc36dd40-96e3-4c2a-a63b-17b661eed245 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:22.893898 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fc36dd40-96e3-4c2a-a63b-17b661eed245 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:22.900519 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc36dd40-96e3-4c2a-a63b-17b661eed245 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:22.901047 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc36dd40-96e3-4c2a-a63b-17b661eed245 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:22.901475 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc36dd40-96e3-4c2a-a63b-17b661eed245 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:22.902163 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc36dd40-96e3-4c2a-a63b-17b661eed245 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:22.902606 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc36dd40-96e3-4c2a-a63b-17b661eed245 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:22.903023 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc36dd40-96e3-4c2a-a63b-17b661eed245 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:23.038911 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fc36dd40-96e3-4c2a-a63b-17b661eed245 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:23.048152 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fc36dd40-96e3-4c2a-a63b-17b661eed245 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:23.049659 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fc36dd40-96e3-4c2a-a63b-17b661eed245 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:23.050828 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fc36dd40-96e3-4c2a-a63b-17b661eed245 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1724 microversion: 2.20 time: 0.161555 Sep 06 21:23:23.051378 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 490/991] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:22 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:24.080088 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1048bbeb-cd3a-4fa1-b9a1-e2b32209aa7f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:24.080984 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1048bbeb-cd3a-4fa1-b9a1-e2b32209aa7f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:24.088251 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1048bbeb-cd3a-4fa1-b9a1-e2b32209aa7f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:24.088726 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1048bbeb-cd3a-4fa1-b9a1-e2b32209aa7f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:24.089182 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1048bbeb-cd3a-4fa1-b9a1-e2b32209aa7f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:24.089883 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1048bbeb-cd3a-4fa1-b9a1-e2b32209aa7f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:24.090334 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1048bbeb-cd3a-4fa1-b9a1-e2b32209aa7f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:24.090753 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1048bbeb-cd3a-4fa1-b9a1-e2b32209aa7f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:24.245373 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1048bbeb-cd3a-4fa1-b9a1-e2b32209aa7f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:24.256224 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1048bbeb-cd3a-4fa1-b9a1-e2b32209aa7f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:24.257844 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1048bbeb-cd3a-4fa1-b9a1-e2b32209aa7f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:24.259029 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1048bbeb-cd3a-4fa1-b9a1-e2b32209aa7f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1745 microversion: 2.20 time: 0.184307 Sep 06 21:23:24.259558 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 502/992] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:24 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1745 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:25.294509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9d3d89f1-59bc-47dc-8dc6-1d1e5f8c8cd3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:25.295466 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9d3d89f1-59bc-47dc-8dc6-1d1e5f8c8cd3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:25.304172 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d3d89f1-59bc-47dc-8dc6-1d1e5f8c8cd3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:25.304681 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d3d89f1-59bc-47dc-8dc6-1d1e5f8c8cd3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:25.305114 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d3d89f1-59bc-47dc-8dc6-1d1e5f8c8cd3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:25.305809 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d3d89f1-59bc-47dc-8dc6-1d1e5f8c8cd3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:25.306253 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d3d89f1-59bc-47dc-8dc6-1d1e5f8c8cd3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:25.306651 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d3d89f1-59bc-47dc-8dc6-1d1e5f8c8cd3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:25.438173 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9d3d89f1-59bc-47dc-8dc6-1d1e5f8c8cd3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:25.446714 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9d3d89f1-59bc-47dc-8dc6-1d1e5f8c8cd3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:25.448169 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9d3d89f1-59bc-47dc-8dc6-1d1e5f8c8cd3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:25.449360 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9d3d89f1-59bc-47dc-8dc6-1d1e5f8c8cd3 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1745 microversion: 2.20 time: 0.161540 Sep 06 21:23:25.449921 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 491/993] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:25 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:26.477122 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8e4ef761-26c1-4daf-a9e5-196c7226e46e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:26.477759 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8e4ef761-26c1-4daf-a9e5-196c7226e46e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:26.484761 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e4ef761-26c1-4daf-a9e5-196c7226e46e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:26.485244 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e4ef761-26c1-4daf-a9e5-196c7226e46e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:26.485674 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e4ef761-26c1-4daf-a9e5-196c7226e46e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:26.486371 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e4ef761-26c1-4daf-a9e5-196c7226e46e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:26.486877 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e4ef761-26c1-4daf-a9e5-196c7226e46e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:26.487326 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8e4ef761-26c1-4daf-a9e5-196c7226e46e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:26.778968 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8e4ef761-26c1-4daf-a9e5-196c7226e46e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:26.789130 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8e4ef761-26c1-4daf-a9e5-196c7226e46e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:26.790552 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8e4ef761-26c1-4daf-a9e5-196c7226e46e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:26.791709 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8e4ef761-26c1-4daf-a9e5-196c7226e46e tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1745 microversion: 2.20 time: 0.318704 Sep 06 21:23:26.792261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 503/994] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:26 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1745 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:27.821434 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f428c7bd-ff85-4778-bb09-70e6738d0371 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:27.822327 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f428c7bd-ff85-4778-bb09-70e6738d0371 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:27.831365 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f428c7bd-ff85-4778-bb09-70e6738d0371 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:27.831851 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f428c7bd-ff85-4778-bb09-70e6738d0371 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:27.832278 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f428c7bd-ff85-4778-bb09-70e6738d0371 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:27.833008 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f428c7bd-ff85-4778-bb09-70e6738d0371 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:27.833459 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f428c7bd-ff85-4778-bb09-70e6738d0371 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:27.833880 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f428c7bd-ff85-4778-bb09-70e6738d0371 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:27.977439 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f428c7bd-ff85-4778-bb09-70e6738d0371 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:27.985926 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f428c7bd-ff85-4778-bb09-70e6738d0371 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:27.987378 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f428c7bd-ff85-4778-bb09-70e6738d0371 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:27.988554 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f428c7bd-ff85-4778-bb09-70e6738d0371 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1745 microversion: 2.20 time: 0.173302 Sep 06 21:23:27.989169 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 492/995] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:27 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:28.332444 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-362332d6-548e-42a7-a68b-5c9ddcf29584 req-167a0f67-dd81-4b71-81cc-dd892e30461c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8066f708-d355-454f-b0fd-7b33e51e265e", "name": "network-vif-plugged", "status": "completed", "tag": "d805515a-5f19-4507-b89b-93b54084b935"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:23:28.343429 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-362332d6-548e-42a7-a68b-5c9ddcf29584 req-167a0f67-dd81-4b71-81cc-dd892e30461c service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:28.344193 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-362332d6-548e-42a7-a68b-5c9ddcf29584 req-167a0f67-dd81-4b71-81cc-dd892e30461c service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:28.344627 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-362332d6-548e-42a7-a68b-5c9ddcf29584 req-167a0f67-dd81-4b71-81cc-dd892e30461c service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:28.356317 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-362332d6-548e-42a7-a68b-5c9ddcf29584 req-167a0f67-dd81-4b71-81cc-dd892e30461c service nova] Creating event network-vif-plugged:d805515a-5f19-4507-b89b-93b54084b935 for instance 8066f708-d355-454f-b0fd-7b33e51e265e on hv-cinder-74915 Sep 06 21:23:28.361753 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-362332d6-548e-42a7-a68b-5c9ddcf29584 req-167a0f67-dd81-4b71-81cc-dd892e30461c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033165 Sep 06 21:23:28.362509 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 504/996] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:23:29.017676 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-98d9b9b3-4862-4020-9ccf-78d317601fed tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:29.018373 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-98d9b9b3-4862-4020-9ccf-78d317601fed tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:29.028736 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98d9b9b3-4862-4020-9ccf-78d317601fed tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:29.029347 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98d9b9b3-4862-4020-9ccf-78d317601fed tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:29.029990 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98d9b9b3-4862-4020-9ccf-78d317601fed tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:29.031082 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98d9b9b3-4862-4020-9ccf-78d317601fed tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:29.031751 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98d9b9b3-4862-4020-9ccf-78d317601fed tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:29.032402 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98d9b9b3-4862-4020-9ccf-78d317601fed tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:29.190799 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-98d9b9b3-4862-4020-9ccf-78d317601fed tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:29.203685 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-98d9b9b3-4862-4020-9ccf-78d317601fed tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:29.205938 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-98d9b9b3-4862-4020-9ccf-78d317601fed tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:29.207127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-98d9b9b3-4862-4020-9ccf-78d317601fed tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1745 microversion: 2.20 time: 0.195816 Sep 06 21:23:29.207768 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 493/997] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:29 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1745 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:30.238526 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-af85ca2e-fda2-405a-ade5-20f5cf829550 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:30.239263 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-af85ca2e-fda2-405a-ade5-20f5cf829550 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:30.248370 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af85ca2e-fda2-405a-ade5-20f5cf829550 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:30.249032 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af85ca2e-fda2-405a-ade5-20f5cf829550 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:30.249667 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af85ca2e-fda2-405a-ade5-20f5cf829550 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:30.250692 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af85ca2e-fda2-405a-ade5-20f5cf829550 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:30.251365 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af85ca2e-fda2-405a-ade5-20f5cf829550 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:30.251941 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af85ca2e-fda2-405a-ade5-20f5cf829550 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:30.397314 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-af85ca2e-fda2-405a-ade5-20f5cf829550 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:30.406031 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-af85ca2e-fda2-405a-ade5-20f5cf829550 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:30.407468 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-af85ca2e-fda2-405a-ade5-20f5cf829550 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:30.408842 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-af85ca2e-fda2-405a-ade5-20f5cf829550 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1745 microversion: 2.20 time: 0.177875 Sep 06 21:23:30.410166 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 505/998] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:30 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:31.441440 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ecc2deac-0b6e-46d8-9b6d-8b76d6197386 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:31.442312 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ecc2deac-0b6e-46d8-9b6d-8b76d6197386 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:31.453465 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ecc2deac-0b6e-46d8-9b6d-8b76d6197386 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:31.454260 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ecc2deac-0b6e-46d8-9b6d-8b76d6197386 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:31.454930 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ecc2deac-0b6e-46d8-9b6d-8b76d6197386 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:31.455942 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ecc2deac-0b6e-46d8-9b6d-8b76d6197386 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:31.456444 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ecc2deac-0b6e-46d8-9b6d-8b76d6197386 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:31.456868 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ecc2deac-0b6e-46d8-9b6d-8b76d6197386 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:31.614097 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ecc2deac-0b6e-46d8-9b6d-8b76d6197386 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:31.623512 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ecc2deac-0b6e-46d8-9b6d-8b76d6197386 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:31.624969 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ecc2deac-0b6e-46d8-9b6d-8b76d6197386 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:31.626309 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ecc2deac-0b6e-46d8-9b6d-8b76d6197386 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1740 microversion: 2.20 time: 0.192387 Sep 06 21:23:31.627027 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 494/999] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:31 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:32.657382 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a00427af-a507-4d21-8142-ecb15910dc9f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:32.659862 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a00427af-a507-4d21-8142-ecb15910dc9f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:32.669019 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a00427af-a507-4d21-8142-ecb15910dc9f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:32.670115 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a00427af-a507-4d21-8142-ecb15910dc9f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:32.670835 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a00427af-a507-4d21-8142-ecb15910dc9f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:32.673235 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a00427af-a507-4d21-8142-ecb15910dc9f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:32.674000 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a00427af-a507-4d21-8142-ecb15910dc9f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:32.674637 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a00427af-a507-4d21-8142-ecb15910dc9f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:32.844543 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a00427af-a507-4d21-8142-ecb15910dc9f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:32.853434 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a00427af-a507-4d21-8142-ecb15910dc9f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:32.855157 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a00427af-a507-4d21-8142-ecb15910dc9f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:32.856673 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a00427af-a507-4d21-8142-ecb15910dc9f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1740 microversion: 2.20 time: 0.204878 Sep 06 21:23:32.857563 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 506/1000] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:32 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:33.888976 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e784a1dc-fdf0-44f9-bc1f-c49aef450abd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:33.889555 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e784a1dc-fdf0-44f9-bc1f-c49aef450abd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:33.897562 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e784a1dc-fdf0-44f9-bc1f-c49aef450abd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:33.898081 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e784a1dc-fdf0-44f9-bc1f-c49aef450abd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:33.898522 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e784a1dc-fdf0-44f9-bc1f-c49aef450abd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:33.899233 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e784a1dc-fdf0-44f9-bc1f-c49aef450abd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:33.899692 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e784a1dc-fdf0-44f9-bc1f-c49aef450abd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:33.900122 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e784a1dc-fdf0-44f9-bc1f-c49aef450abd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:34.059355 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e784a1dc-fdf0-44f9-bc1f-c49aef450abd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:34.072069 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e784a1dc-fdf0-44f9-bc1f-c49aef450abd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:34.073515 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e784a1dc-fdf0-44f9-bc1f-c49aef450abd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:34.075071 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e784a1dc-fdf0-44f9-bc1f-c49aef450abd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1740 microversion: 2.20 time: 0.190771 Sep 06 21:23:34.075258 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 495/1001] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:33 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:35.100258 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-100b79b7-35cf-4f44-adeb-6e2441d9eda7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:35.100907 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-100b79b7-35cf-4f44-adeb-6e2441d9eda7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:35.103587 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=27 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:35.109213 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-100b79b7-35cf-4f44-adeb-6e2441d9eda7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:35.109788 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-100b79b7-35cf-4f44-adeb-6e2441d9eda7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:35.110299 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-100b79b7-35cf-4f44-adeb-6e2441d9eda7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:35.111096 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-100b79b7-35cf-4f44-adeb-6e2441d9eda7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:35.111697 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-100b79b7-35cf-4f44-adeb-6e2441d9eda7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:35.112197 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-100b79b7-35cf-4f44-adeb-6e2441d9eda7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:35.115310 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=73 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:35.276493 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-100b79b7-35cf-4f44-adeb-6e2441d9eda7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:35.287893 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-100b79b7-35cf-4f44-adeb-6e2441d9eda7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:35.290792 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-100b79b7-35cf-4f44-adeb-6e2441d9eda7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:35.292371 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-100b79b7-35cf-4f44-adeb-6e2441d9eda7 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1740 microversion: 2.20 time: 0.196713 Sep 06 21:23:35.293353 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 507/1002] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:35 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:36.319916 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cec3fecb-f0e7-4b6f-80c8-9a128515be74 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:36.321659 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cec3fecb-f0e7-4b6f-80c8-9a128515be74 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:36.328827 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cec3fecb-f0e7-4b6f-80c8-9a128515be74 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:36.329308 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cec3fecb-f0e7-4b6f-80c8-9a128515be74 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:36.329735 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cec3fecb-f0e7-4b6f-80c8-9a128515be74 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:36.330450 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cec3fecb-f0e7-4b6f-80c8-9a128515be74 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:36.330905 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cec3fecb-f0e7-4b6f-80c8-9a128515be74 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:36.331361 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cec3fecb-f0e7-4b6f-80c8-9a128515be74 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:36.793078 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cec3fecb-f0e7-4b6f-80c8-9a128515be74 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:36.802813 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cec3fecb-f0e7-4b6f-80c8-9a128515be74 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:36.804274 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cec3fecb-f0e7-4b6f-80c8-9a128515be74 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:36.805856 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cec3fecb-f0e7-4b6f-80c8-9a128515be74 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1740 microversion: 2.20 time: 0.490081 Sep 06 21:23:36.815786 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 496/1003] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:36 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1740 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:37.836513 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3f259af4-f662-4ea2-af4f-1815557ed6aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:37.838801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3f259af4-f662-4ea2-af4f-1815557ed6aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:37.850259 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f259af4-f662-4ea2-af4f-1815557ed6aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:37.851781 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f259af4-f662-4ea2-af4f-1815557ed6aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:37.852749 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f259af4-f662-4ea2-af4f-1815557ed6aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:37.853750 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f259af4-f662-4ea2-af4f-1815557ed6aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:37.854623 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f259af4-f662-4ea2-af4f-1815557ed6aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:37.855050 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f259af4-f662-4ea2-af4f-1815557ed6aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:38.011392 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3f259af4-f662-4ea2-af4f-1815557ed6aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:38.022287 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3f259af4-f662-4ea2-af4f-1815557ed6aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:38.023757 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3f259af4-f662-4ea2-af4f-1815557ed6aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:38.024999 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3f259af4-f662-4ea2-af4f-1815557ed6aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1740 microversion: 2.20 time: 0.197085 Sep 06 21:23:38.025733 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 508/1004] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:37 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:39.054821 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f9c0768d-bfa4-41d3-b4d5-73fe1172ee1d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:39.055990 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f9c0768d-bfa4-41d3-b4d5-73fe1172ee1d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:39.061794 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=29 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:39.069566 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9c0768d-bfa4-41d3-b4d5-73fe1172ee1d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:39.070051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9c0768d-bfa4-41d3-b4d5-73fe1172ee1d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:39.070489 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9c0768d-bfa4-41d3-b4d5-73fe1172ee1d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:39.071262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9c0768d-bfa4-41d3-b4d5-73fe1172ee1d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:39.071724 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9c0768d-bfa4-41d3-b4d5-73fe1172ee1d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:39.072158 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9c0768d-bfa4-41d3-b4d5-73fe1172ee1d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:39.079014 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:39.224370 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f9c0768d-bfa4-41d3-b4d5-73fe1172ee1d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:39.233641 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f9c0768d-bfa4-41d3-b4d5-73fe1172ee1d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:39.235185 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f9c0768d-bfa4-41d3-b4d5-73fe1172ee1d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:39.236694 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f9c0768d-bfa4-41d3-b4d5-73fe1172ee1d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1740 microversion: 2.20 time: 0.188770 Sep 06 21:23:39.237272 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 497/1005] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:39 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:40.262429 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-45f65598-9b0b-49f7-b131-c707926af861 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:40.263030 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-45f65598-9b0b-49f7-b131-c707926af861 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:40.270051 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-45f65598-9b0b-49f7-b131-c707926af861 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:40.270527 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-45f65598-9b0b-49f7-b131-c707926af861 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:40.270950 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-45f65598-9b0b-49f7-b131-c707926af861 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:40.271763 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-45f65598-9b0b-49f7-b131-c707926af861 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:40.272215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-45f65598-9b0b-49f7-b131-c707926af861 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:40.272635 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-45f65598-9b0b-49f7-b131-c707926af861 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:40.422842 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-45f65598-9b0b-49f7-b131-c707926af861 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:40.431308 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-45f65598-9b0b-49f7-b131-c707926af861 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:40.432754 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-45f65598-9b0b-49f7-b131-c707926af861 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:40.433924 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-45f65598-9b0b-49f7-b131-c707926af861 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1740 microversion: 2.20 time: 0.175405 Sep 06 21:23:40.434526 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 509/1006] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:40 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:41.459711 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c70b3e19-bc8d-44d2-91fc-5b5c1061b8a4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:41.460351 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c70b3e19-bc8d-44d2-91fc-5b5c1061b8a4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:41.467954 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c70b3e19-bc8d-44d2-91fc-5b5c1061b8a4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:41.468435 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c70b3e19-bc8d-44d2-91fc-5b5c1061b8a4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:41.468903 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c70b3e19-bc8d-44d2-91fc-5b5c1061b8a4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:41.469589 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c70b3e19-bc8d-44d2-91fc-5b5c1061b8a4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:41.470061 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c70b3e19-bc8d-44d2-91fc-5b5c1061b8a4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:41.470474 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c70b3e19-bc8d-44d2-91fc-5b5c1061b8a4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:41.687083 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c70b3e19-bc8d-44d2-91fc-5b5c1061b8a4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:41.695912 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c70b3e19-bc8d-44d2-91fc-5b5c1061b8a4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:41.697419 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c70b3e19-bc8d-44d2-91fc-5b5c1061b8a4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:41.698582 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c70b3e19-bc8d-44d2-91fc-5b5c1061b8a4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1722 microversion: 2.20 time: 0.242983 Sep 06 21:23:41.699430 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 498/1007] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:41 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:42.726427 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-18e01426-0292-4b59-b4d2-fb09f0be6665 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:42.727326 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-18e01426-0292-4b59-b4d2-fb09f0be6665 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:42.736009 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-18e01426-0292-4b59-b4d2-fb09f0be6665 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:42.736603 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-18e01426-0292-4b59-b4d2-fb09f0be6665 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:42.737174 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-18e01426-0292-4b59-b4d2-fb09f0be6665 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:42.738103 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-18e01426-0292-4b59-b4d2-fb09f0be6665 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:42.738586 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-18e01426-0292-4b59-b4d2-fb09f0be6665 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:42.738993 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-18e01426-0292-4b59-b4d2-fb09f0be6665 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:42.964725 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-18e01426-0292-4b59-b4d2-fb09f0be6665 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:42.973266 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-18e01426-0292-4b59-b4d2-fb09f0be6665 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:42.974709 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-18e01426-0292-4b59-b4d2-fb09f0be6665 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:42.975879 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-18e01426-0292-4b59-b4d2-fb09f0be6665 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1722 microversion: 2.20 time: 0.255377 Sep 06 21:23:42.976430 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 510/1008] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:42 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:44.000877 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-56f2c0a1-a763-481d-80c4-c7bf178351d1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:44.001518 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-56f2c0a1-a763-481d-80c4-c7bf178351d1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:44.008430 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56f2c0a1-a763-481d-80c4-c7bf178351d1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:44.008974 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56f2c0a1-a763-481d-80c4-c7bf178351d1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:44.009400 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56f2c0a1-a763-481d-80c4-c7bf178351d1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:44.010136 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56f2c0a1-a763-481d-80c4-c7bf178351d1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:44.010583 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56f2c0a1-a763-481d-80c4-c7bf178351d1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:44.011003 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56f2c0a1-a763-481d-80c4-c7bf178351d1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:44.201297 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-56f2c0a1-a763-481d-80c4-c7bf178351d1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:44.210027 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-56f2c0a1-a763-481d-80c4-c7bf178351d1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:44.211489 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-56f2c0a1-a763-481d-80c4-c7bf178351d1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:44.212641 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-56f2c0a1-a763-481d-80c4-c7bf178351d1 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1725 microversion: 2.20 time: 0.215844 Sep 06 21:23:44.213251 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 499/1009] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:43 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:44.239257 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ce32d8d2-b8f6-430e-bc9e-d58548c61414 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d3d5066-4a09-4e4b-a5b1-a28441c3075d"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:23:44.241615 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ce32d8d2-b8f6-430e-bc9e-d58548c61414 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:44.249307 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce32d8d2-b8f6-430e-bc9e-d58548c61414 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:44.249785 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce32d8d2-b8f6-430e-bc9e-d58548c61414 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:44.250218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce32d8d2-b8f6-430e-bc9e-d58548c61414 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:44.250922 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce32d8d2-b8f6-430e-bc9e-d58548c61414 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:44.251358 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce32d8d2-b8f6-430e-bc9e-d58548c61414 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:44.251779 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce32d8d2-b8f6-430e-bc9e-d58548c61414 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:44.348794 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-248d40f9-6781-4efd-ad05-6e1474af51f0 req-a9a54358-49ed-4907-8efd-6422bc452599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8066f708-d355-454f-b0fd-7b33e51e265e", "name": "network-vif-unplugged", "status": "completed", "tag": "d805515a-5f19-4507-b89b-93b54084b935"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:23:44.360772 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-248d40f9-6781-4efd-ad05-6e1474af51f0 req-a9a54358-49ed-4907-8efd-6422bc452599 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:44.361450 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-248d40f9-6781-4efd-ad05-6e1474af51f0 req-a9a54358-49ed-4907-8efd-6422bc452599 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:44.362042 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-248d40f9-6781-4efd-ad05-6e1474af51f0 req-a9a54358-49ed-4907-8efd-6422bc452599 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:44.375211 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-248d40f9-6781-4efd-ad05-6e1474af51f0 req-a9a54358-49ed-4907-8efd-6422bc452599 service nova] Creating event network-vif-unplugged:d805515a-5f19-4507-b89b-93b54084b935 for instance 8066f708-d355-454f-b0fd-7b33e51e265e on hv-cinder-74915 Sep 06 21:23:44.381500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-248d40f9-6781-4efd-ad05-6e1474af51f0 req-a9a54358-49ed-4907-8efd-6422bc452599 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037006 Sep 06 21:23:44.382464 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 500/1010] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:23:44.562356 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ce32d8d2-b8f6-430e-bc9e-d58548c61414 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "POST /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.327415 Sep 06 21:23:44.563242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 511/1011] 10.222.0.79 () {62 vars in 1364 bytes} [Tue Sep 6 21:23:44 2022] POST /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e/os-volume_attachments => generated 188 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 21:23:44.700926 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-26ba72d7-4328-4bad-817a-8baac039cb53 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:44.701936 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-26ba72d7-4328-4bad-817a-8baac039cb53 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:44.712450 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26ba72d7-4328-4bad-817a-8baac039cb53 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:44.713293 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26ba72d7-4328-4bad-817a-8baac039cb53 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:44.713919 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26ba72d7-4328-4bad-817a-8baac039cb53 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:44.714883 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26ba72d7-4328-4bad-817a-8baac039cb53 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:44.715551 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26ba72d7-4328-4bad-817a-8baac039cb53 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:44.716176 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26ba72d7-4328-4bad-817a-8baac039cb53 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:44.995893 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-26ba72d7-4328-4bad-817a-8baac039cb53 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e/os-volume_attachments/8d3d5066-4a09-4e4b-a5b1-a28441c3075d" status: 202 len: 0 microversion: 2.20 time: 0.301996 Sep 06 21:23:44.996470 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 501/1012] 10.222.0.79 () {60 vars in 1457 bytes} [Tue Sep 6 21:23:44 2022] DELETE /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e/os-volume_attachments/8d3d5066-4a09-4e4b-a5b1-a28441c3075d => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 21:23:45.062032 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6cc1f84f-034b-4d4a-a11a-2e980189db87 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:23:45.062801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6cc1f84f-034b-4d4a-a11a-2e980189db87 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:45.072878 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6cc1f84f-034b-4d4a-a11a-2e980189db87 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:45.073526 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6cc1f84f-034b-4d4a-a11a-2e980189db87 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:45.074053 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6cc1f84f-034b-4d4a-a11a-2e980189db87 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:45.075019 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6cc1f84f-034b-4d4a-a11a-2e980189db87 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:45.075461 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6cc1f84f-034b-4d4a-a11a-2e980189db87 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:45.076012 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6cc1f84f-034b-4d4a-a11a-2e980189db87 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:45.107558 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6cc1f84f-034b-4d4a-a11a-2e980189db87 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120719) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 06 21:23:45.181895 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6cc1f84f-034b-4d4a-a11a-2e980189db87 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "POST /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e/action" status: 202 len: 0 microversion: 2.20 time: 0.126692 Sep 06 21:23:45.182504 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 512/1013] 10.222.0.79 () {62 vars in 1319 bytes} [Tue Sep 6 21:23:45 2022] POST /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 21:23:45.190697 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bd7dace9-19a0-4c92-9bf8-7d4b0b701b54 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:45.191311 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bd7dace9-19a0-4c92-9bf8-7d4b0b701b54 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:45.198019 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd7dace9-19a0-4c92-9bf8-7d4b0b701b54 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:45.198399 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd7dace9-19a0-4c92-9bf8-7d4b0b701b54 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:45.198793 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd7dace9-19a0-4c92-9bf8-7d4b0b701b54 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:45.199484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd7dace9-19a0-4c92-9bf8-7d4b0b701b54 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:45.199977 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd7dace9-19a0-4c92-9bf8-7d4b0b701b54 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:45.200382 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd7dace9-19a0-4c92-9bf8-7d4b0b701b54 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:45.335538 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bd7dace9-19a0-4c92-9bf8-7d4b0b701b54 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:45.344083 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bd7dace9-19a0-4c92-9bf8-7d4b0b701b54 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:45.345523 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bd7dace9-19a0-4c92-9bf8-7d4b0b701b54 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:45.346706 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bd7dace9-19a0-4c92-9bf8-7d4b0b701b54 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1673 microversion: 2.20 time: 0.159952 Sep 06 21:23:45.347227 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 502/1014] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:45 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:46.379429 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4e3cdab2-3f52-4367-91c8-d1ff8f98c0b9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:46.380400 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4e3cdab2-3f52-4367-91c8-d1ff8f98c0b9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:46.391496 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e3cdab2-3f52-4367-91c8-d1ff8f98c0b9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:46.392363 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e3cdab2-3f52-4367-91c8-d1ff8f98c0b9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:46.393181 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e3cdab2-3f52-4367-91c8-d1ff8f98c0b9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:46.394466 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e3cdab2-3f52-4367-91c8-d1ff8f98c0b9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:46.395272 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e3cdab2-3f52-4367-91c8-d1ff8f98c0b9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:46.396300 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e3cdab2-3f52-4367-91c8-d1ff8f98c0b9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:46.534994 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4e3cdab2-3f52-4367-91c8-d1ff8f98c0b9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:46.543694 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4e3cdab2-3f52-4367-91c8-d1ff8f98c0b9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:46.545141 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4e3cdab2-3f52-4367-91c8-d1ff8f98c0b9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:46.546657 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4e3cdab2-3f52-4367-91c8-d1ff8f98c0b9 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1731 microversion: 2.20 time: 0.174918 Sep 06 21:23:46.547217 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 513/1015] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:46 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:47.574307 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9d8703d0-7333-48c1-99fd-ff45e2fab360 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:47.575877 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9d8703d0-7333-48c1-99fd-ff45e2fab360 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:47.584078 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d8703d0-7333-48c1-99fd-ff45e2fab360 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:47.584809 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d8703d0-7333-48c1-99fd-ff45e2fab360 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:47.585483 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d8703d0-7333-48c1-99fd-ff45e2fab360 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:47.586310 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d8703d0-7333-48c1-99fd-ff45e2fab360 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:47.587214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d8703d0-7333-48c1-99fd-ff45e2fab360 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:47.587897 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d8703d0-7333-48c1-99fd-ff45e2fab360 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:47.737852 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9d8703d0-7333-48c1-99fd-ff45e2fab360 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:47.747757 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9d8703d0-7333-48c1-99fd-ff45e2fab360 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:47.749585 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9d8703d0-7333-48c1-99fd-ff45e2fab360 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:47.750786 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9d8703d0-7333-48c1-99fd-ff45e2fab360 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1731 microversion: 2.20 time: 0.181414 Sep 06 21:23:47.751531 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 503/1016] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:47 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:48.777106 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6adf75a2-58e3-4af4-85f4-225b60f8bb7a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:48.777727 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6adf75a2-58e3-4af4-85f4-225b60f8bb7a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:48.787100 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6adf75a2-58e3-4af4-85f4-225b60f8bb7a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:48.787767 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6adf75a2-58e3-4af4-85f4-225b60f8bb7a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:48.788199 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6adf75a2-58e3-4af4-85f4-225b60f8bb7a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:48.789074 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6adf75a2-58e3-4af4-85f4-225b60f8bb7a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:48.789531 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6adf75a2-58e3-4af4-85f4-225b60f8bb7a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:48.789955 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6adf75a2-58e3-4af4-85f4-225b60f8bb7a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:48.933054 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6adf75a2-58e3-4af4-85f4-225b60f8bb7a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:48.941542 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6adf75a2-58e3-4af4-85f4-225b60f8bb7a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:48.942959 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6adf75a2-58e3-4af4-85f4-225b60f8bb7a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:48.944139 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6adf75a2-58e3-4af4-85f4-225b60f8bb7a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1731 microversion: 2.20 time: 0.171384 Sep 06 21:23:48.951400 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 514/1017] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:48 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:49.971181 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ca39db09-5889-444b-b778-aa56b2f2e400 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:49.971786 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ca39db09-5889-444b-b778-aa56b2f2e400 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:49.979291 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca39db09-5889-444b-b778-aa56b2f2e400 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:49.979933 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca39db09-5889-444b-b778-aa56b2f2e400 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:49.980465 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca39db09-5889-444b-b778-aa56b2f2e400 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:49.981292 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca39db09-5889-444b-b778-aa56b2f2e400 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:49.981873 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca39db09-5889-444b-b778-aa56b2f2e400 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:49.982367 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca39db09-5889-444b-b778-aa56b2f2e400 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:50.120940 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ca39db09-5889-444b-b778-aa56b2f2e400 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:50.129392 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ca39db09-5889-444b-b778-aa56b2f2e400 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:50.130832 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ca39db09-5889-444b-b778-aa56b2f2e400 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:50.132080 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ca39db09-5889-444b-b778-aa56b2f2e400 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1731 microversion: 2.20 time: 0.164922 Sep 06 21:23:50.132841 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 504/1018] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:49 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:51.158055 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-09e7d48f-083b-4442-b3b5-9ef2be37eba0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:51.158804 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-09e7d48f-083b-4442-b3b5-9ef2be37eba0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:51.165973 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09e7d48f-083b-4442-b3b5-9ef2be37eba0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:51.166478 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09e7d48f-083b-4442-b3b5-9ef2be37eba0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:51.166875 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09e7d48f-083b-4442-b3b5-9ef2be37eba0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:51.167585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09e7d48f-083b-4442-b3b5-9ef2be37eba0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:51.168028 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09e7d48f-083b-4442-b3b5-9ef2be37eba0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:51.168603 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09e7d48f-083b-4442-b3b5-9ef2be37eba0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:51.311579 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-09e7d48f-083b-4442-b3b5-9ef2be37eba0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:51.321254 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-09e7d48f-083b-4442-b3b5-9ef2be37eba0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:51.322696 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-09e7d48f-083b-4442-b3b5-9ef2be37eba0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:51.323919 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-09e7d48f-083b-4442-b3b5-9ef2be37eba0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1731 microversion: 2.20 time: 0.169883 Sep 06 21:23:51.324474 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 515/1019] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:51 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:52.349407 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-757621bb-ed3b-4347-a8c5-cede5a2bb0be tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:52.349996 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-757621bb-ed3b-4347-a8c5-cede5a2bb0be tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:52.357215 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-757621bb-ed3b-4347-a8c5-cede5a2bb0be tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:52.357697 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-757621bb-ed3b-4347-a8c5-cede5a2bb0be tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:52.359810 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-757621bb-ed3b-4347-a8c5-cede5a2bb0be tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:52.360566 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-757621bb-ed3b-4347-a8c5-cede5a2bb0be tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:52.361060 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-757621bb-ed3b-4347-a8c5-cede5a2bb0be tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:52.361503 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-757621bb-ed3b-4347-a8c5-cede5a2bb0be tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:52.499655 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-757621bb-ed3b-4347-a8c5-cede5a2bb0be tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:52.508397 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-757621bb-ed3b-4347-a8c5-cede5a2bb0be tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:52.510193 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-757621bb-ed3b-4347-a8c5-cede5a2bb0be tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:52.511596 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-757621bb-ed3b-4347-a8c5-cede5a2bb0be tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1731 microversion: 2.20 time: 0.166523 Sep 06 21:23:52.512258 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 505/1020] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:52 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:53.699538 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-09eb68a3-077f-4154-9968-91dab492db8a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:53.700172 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-09eb68a3-077f-4154-9968-91dab492db8a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:53.706361 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09eb68a3-077f-4154-9968-91dab492db8a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:53.706849 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09eb68a3-077f-4154-9968-91dab492db8a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:53.707283 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09eb68a3-077f-4154-9968-91dab492db8a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:53.707991 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09eb68a3-077f-4154-9968-91dab492db8a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:53.708446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09eb68a3-077f-4154-9968-91dab492db8a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:53.708896 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09eb68a3-077f-4154-9968-91dab492db8a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:53.852537 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-09eb68a3-077f-4154-9968-91dab492db8a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:53.863693 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-09eb68a3-077f-4154-9968-91dab492db8a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:53.865161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-09eb68a3-077f-4154-9968-91dab492db8a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:53.866345 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-09eb68a3-077f-4154-9968-91dab492db8a tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1731 microversion: 2.20 time: 0.332535 Sep 06 21:23:53.867008 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 516/1021] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:53 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1731 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:54.893159 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5be2233d-56aa-427a-8768-c4ac2d745e2c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:54.893748 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5be2233d-56aa-427a-8768-c4ac2d745e2c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:54.900644 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5be2233d-56aa-427a-8768-c4ac2d745e2c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:54.901156 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5be2233d-56aa-427a-8768-c4ac2d745e2c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:54.901580 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5be2233d-56aa-427a-8768-c4ac2d745e2c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:54.902277 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5be2233d-56aa-427a-8768-c4ac2d745e2c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:54.902716 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5be2233d-56aa-427a-8768-c4ac2d745e2c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:54.903127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5be2233d-56aa-427a-8768-c4ac2d745e2c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:55.058951 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5be2233d-56aa-427a-8768-c4ac2d745e2c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:55.067512 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5be2233d-56aa-427a-8768-c4ac2d745e2c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:55.069014 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5be2233d-56aa-427a-8768-c4ac2d745e2c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:55.070176 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5be2233d-56aa-427a-8768-c4ac2d745e2c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1731 microversion: 2.20 time: 0.181165 Sep 06 21:23:55.073213 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 506/1022] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:54 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:56.095686 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-92989c77-2676-47ef-8222-d374143d71dc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:56.096406 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-92989c77-2676-47ef-8222-d374143d71dc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:56.103548 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92989c77-2676-47ef-8222-d374143d71dc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:56.104035 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92989c77-2676-47ef-8222-d374143d71dc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:56.104466 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92989c77-2676-47ef-8222-d374143d71dc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:56.105213 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92989c77-2676-47ef-8222-d374143d71dc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:56.105661 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92989c77-2676-47ef-8222-d374143d71dc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:56.106122 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92989c77-2676-47ef-8222-d374143d71dc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:56.247191 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-92989c77-2676-47ef-8222-d374143d71dc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:56.256800 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-92989c77-2676-47ef-8222-d374143d71dc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:56.258476 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-92989c77-2676-47ef-8222-d374143d71dc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:56.259858 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-92989c77-2676-47ef-8222-d374143d71dc tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1731 microversion: 2.20 time: 0.168119 Sep 06 21:23:56.260414 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 517/1023] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:56 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:57.286557 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cf968670-fea0-49e6-b4d8-9ccd54922eca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:57.287212 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cf968670-fea0-49e6-b4d8-9ccd54922eca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:57.294071 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf968670-fea0-49e6-b4d8-9ccd54922eca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:57.294552 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf968670-fea0-49e6-b4d8-9ccd54922eca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:57.294977 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf968670-fea0-49e6-b4d8-9ccd54922eca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:57.295641 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf968670-fea0-49e6-b4d8-9ccd54922eca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:57.296483 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf968670-fea0-49e6-b4d8-9ccd54922eca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:57.296925 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf968670-fea0-49e6-b4d8-9ccd54922eca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:57.444712 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cf968670-fea0-49e6-b4d8-9ccd54922eca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:57.453474 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cf968670-fea0-49e6-b4d8-9ccd54922eca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:57.454894 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cf968670-fea0-49e6-b4d8-9ccd54922eca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:57.456034 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cf968670-fea0-49e6-b4d8-9ccd54922eca tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1731 microversion: 2.20 time: 0.173533 Sep 06 21:23:57.456583 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 507/1024] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:57 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:57.642067 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9e72ad46-1654-42b6-9539-55f0b1115dab tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:57.642720 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9e72ad46-1654-42b6-9539-55f0b1115dab tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:57.650463 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e72ad46-1654-42b6-9539-55f0b1115dab tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:57.651112 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e72ad46-1654-42b6-9539-55f0b1115dab tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:57.651830 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e72ad46-1654-42b6-9539-55f0b1115dab tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:57.652761 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e72ad46-1654-42b6-9539-55f0b1115dab tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:57.653265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e72ad46-1654-42b6-9539-55f0b1115dab tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:57.653903 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e72ad46-1654-42b6-9539-55f0b1115dab tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:57.685615 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9e72ad46-1654-42b6-9539-55f0b1115dab tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/ips" status: 200 len: 150 microversion: 2.1 time: 0.047528 Sep 06 21:23:57.686254 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 518/1025] 10.222.0.79 () {58 vars in 1248 bytes} [Tue Sep 6 21:23:57 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:23:58.485282 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-55f901ec-5b3f-4590-a06c-c0ccd2c6df74 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:58.486221 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-55f901ec-5b3f-4590-a06c-c0ccd2c6df74 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:58.497290 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55f901ec-5b3f-4590-a06c-c0ccd2c6df74 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:58.498045 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55f901ec-5b3f-4590-a06c-c0ccd2c6df74 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:58.498809 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55f901ec-5b3f-4590-a06c-c0ccd2c6df74 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:58.499946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55f901ec-5b3f-4590-a06c-c0ccd2c6df74 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:58.500749 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55f901ec-5b3f-4590-a06c-c0ccd2c6df74 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:58.501438 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55f901ec-5b3f-4590-a06c-c0ccd2c6df74 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:58.657233 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-55f901ec-5b3f-4590-a06c-c0ccd2c6df74 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:58.670087 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-55f901ec-5b3f-4590-a06c-c0ccd2c6df74 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:58.672759 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-55f901ec-5b3f-4590-a06c-c0ccd2c6df74 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:58.674318 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-55f901ec-5b3f-4590-a06c-c0ccd2c6df74 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1731 microversion: 2.20 time: 0.195612 Sep 06 21:23:58.675062 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 508/1026] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:58 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:23:59.702775 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dcc6de64-3245-4fe7-8b09-e013a78b8a84 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:23:59.703371 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dcc6de64-3245-4fe7-8b09-e013a78b8a84 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:23:59.710453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dcc6de64-3245-4fe7-8b09-e013a78b8a84 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:59.710963 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dcc6de64-3245-4fe7-8b09-e013a78b8a84 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:59.711401 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dcc6de64-3245-4fe7-8b09-e013a78b8a84 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:59.712097 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dcc6de64-3245-4fe7-8b09-e013a78b8a84 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:23:59.712548 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dcc6de64-3245-4fe7-8b09-e013a78b8a84 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:23:59.712981 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dcc6de64-3245-4fe7-8b09-e013a78b8a84 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:23:59.855465 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-dcc6de64-3245-4fe7-8b09-e013a78b8a84 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:59.863720 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-dcc6de64-3245-4fe7-8b09-e013a78b8a84 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:59.865153 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-dcc6de64-3245-4fe7-8b09-e013a78b8a84 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:23:59.866309 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dcc6de64-3245-4fe7-8b09-e013a78b8a84 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1731 microversion: 2.20 time: 0.167669 Sep 06 21:23:59.867038 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 519/1027] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:23:59 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:24:00.144796 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-59763975-3f33-4422-a753-53e47fbd9b83 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1e113b7-8142-45e1-afe6-c027eca270d5"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:24:00.147241 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-59763975-3f33-4422-a753-53e47fbd9b83 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:00.154438 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59763975-3f33-4422-a753-53e47fbd9b83 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:00.154925 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59763975-3f33-4422-a753-53e47fbd9b83 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:00.155360 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59763975-3f33-4422-a753-53e47fbd9b83 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:00.156071 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59763975-3f33-4422-a753-53e47fbd9b83 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:00.156539 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59763975-3f33-4422-a753-53e47fbd9b83 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:00.156984 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59763975-3f33-4422-a753-53e47fbd9b83 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:00.641995 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-59763975-3f33-4422-a753-53e47fbd9b83 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "POST /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.501092 Sep 06 21:24:00.642617 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 509/1028] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Sep 6 21:24:00 2022] POST /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments => generated 194 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:24:00.900945 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-78ad0878-ba1e-4dc6-a387-d264ad412d97 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:00.901539 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-78ad0878-ba1e-4dc6-a387-d264ad412d97 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:00.908799 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78ad0878-ba1e-4dc6-a387-d264ad412d97 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:00.909283 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78ad0878-ba1e-4dc6-a387-d264ad412d97 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:00.909714 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78ad0878-ba1e-4dc6-a387-d264ad412d97 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:00.910416 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78ad0878-ba1e-4dc6-a387-d264ad412d97 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:00.910864 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78ad0878-ba1e-4dc6-a387-d264ad412d97 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:00.911287 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78ad0878-ba1e-4dc6-a387-d264ad412d97 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:00.927940 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:01.046977 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-78ad0878-ba1e-4dc6-a387-d264ad412d97 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:01.055646 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-78ad0878-ba1e-4dc6-a387-d264ad412d97 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:01.057153 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-78ad0878-ba1e-4dc6-a387-d264ad412d97 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:01.058933 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-78ad0878-ba1e-4dc6-a387-d264ad412d97 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1731 microversion: 2.20 time: 0.163242 Sep 06 21:24:01.058933 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 520/1029] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:24:00 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:24:02.089841 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4e629e22-47f6-4bc1-b350-96214c903ef2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:02.090991 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4e629e22-47f6-4bc1-b350-96214c903ef2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:02.102058 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e629e22-47f6-4bc1-b350-96214c903ef2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:02.102835 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e629e22-47f6-4bc1-b350-96214c903ef2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:02.103280 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e629e22-47f6-4bc1-b350-96214c903ef2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:02.103977 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e629e22-47f6-4bc1-b350-96214c903ef2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:02.104424 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e629e22-47f6-4bc1-b350-96214c903ef2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:02.104873 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e629e22-47f6-4bc1-b350-96214c903ef2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:02.129741 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:02.401017 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4e629e22-47f6-4bc1-b350-96214c903ef2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:02.409155 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4e629e22-47f6-4bc1-b350-96214c903ef2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:02.410559 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4e629e22-47f6-4bc1-b350-96214c903ef2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:02.411704 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4e629e22-47f6-4bc1-b350-96214c903ef2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1731 microversion: 2.20 time: 0.330138 Sep 06 21:24:02.412260 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 510/1030] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:24:02 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1731 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:24:03.380736 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0aed0abe-e052-4df7-905b-6c33bc32d03c tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:03.381908 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0aed0abe-e052-4df7-905b-6c33bc32d03c tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:03.384794 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-963ebc7a-4d5f-4889-b00e-34ccfba2874c req-e9fa00b2-ef74-48c4-a1b9-20ff5bcabee6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "340de6d7-883f-4c26-89b1-4f8536aa09e8", "tag": "e03713ad-150d-4e1c-af49-98c4a6fe49fe"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:24:03.389361 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0aed0abe-e052-4df7-905b-6c33bc32d03c tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:03.390111 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0aed0abe-e052-4df7-905b-6c33bc32d03c tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:03.390861 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0aed0abe-e052-4df7-905b-6c33bc32d03c tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:03.391796 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0aed0abe-e052-4df7-905b-6c33bc32d03c tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:03.392464 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0aed0abe-e052-4df7-905b-6c33bc32d03c tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:03.393150 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0aed0abe-e052-4df7-905b-6c33bc32d03c tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:03.395141 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-963ebc7a-4d5f-4889-b00e-34ccfba2874c req-e9fa00b2-ef74-48c4-a1b9-20ff5bcabee6 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:03.395614 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-963ebc7a-4d5f-4889-b00e-34ccfba2874c req-e9fa00b2-ef74-48c4-a1b9-20ff5bcabee6 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:03.396041 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-963ebc7a-4d5f-4889-b00e-34ccfba2874c req-e9fa00b2-ef74-48c4-a1b9-20ff5bcabee6 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:03.410300 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-963ebc7a-4d5f-4889-b00e-34ccfba2874c req-e9fa00b2-ef74-48c4-a1b9-20ff5bcabee6 service nova] Creating event network-changed:e03713ad-150d-4e1c-af49-98c4a6fe49fe for instance 340de6d7-883f-4c26-89b1-4f8536aa09e8 on hv-cinder-74915 Sep 06 21:24:03.415734 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-963ebc7a-4d5f-4889-b00e-34ccfba2874c req-e9fa00b2-ef74-48c4-a1b9-20ff5bcabee6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034715 Sep 06 21:24:03.416324 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 511/1031] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 21:24:03.424485 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0aed0abe-e052-4df7-905b-6c33bc32d03c tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 21:24:03.444249 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-87c288ff-0946-45f6-9fa4-f13fcc6da106 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:03.446105 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-87c288ff-0946-45f6-9fa4-f13fcc6da106 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:03.456649 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87c288ff-0946-45f6-9fa4-f13fcc6da106 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:03.458051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87c288ff-0946-45f6-9fa4-f13fcc6da106 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:03.459923 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87c288ff-0946-45f6-9fa4-f13fcc6da106 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:03.461014 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87c288ff-0946-45f6-9fa4-f13fcc6da106 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:03.461987 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87c288ff-0946-45f6-9fa4-f13fcc6da106 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:03.462630 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87c288ff-0946-45f6-9fa4-f13fcc6da106 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:03.514789 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0aed0abe-e052-4df7-905b-6c33bc32d03c tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "DELETE /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 204 len: 0 microversion: 2.1 time: 0.139362 Sep 06 21:24:03.515380 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 521/1032] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Sep 6 21:24:03 2022] DELETE /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 21:24:03.524440 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0277b0b3-ba4e-4a5b-9025-57a33b8d1df5 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:03.525468 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0277b0b3-ba4e-4a5b-9025-57a33b8d1df5 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:03.531807 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0277b0b3-ba4e-4a5b-9025-57a33b8d1df5 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:03.532579 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0277b0b3-ba4e-4a5b-9025-57a33b8d1df5 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:03.533201 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0277b0b3-ba4e-4a5b-9025-57a33b8d1df5 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:03.533921 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0277b0b3-ba4e-4a5b-9025-57a33b8d1df5 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:03.534535 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0277b0b3-ba4e-4a5b-9025-57a33b8d1df5 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:03.535154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0277b0b3-ba4e-4a5b-9025-57a33b8d1df5 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:03.625941 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-87c288ff-0946-45f6-9fa4-f13fcc6da106 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:03.634339 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-87c288ff-0946-45f6-9fa4-f13fcc6da106 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:03.635818 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-87c288ff-0946-45f6-9fa4-f13fcc6da106 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:03.637108 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-87c288ff-0946-45f6-9fa4-f13fcc6da106 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1731 microversion: 2.20 time: 0.202412 Sep 06 21:24:03.637570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 512/1033] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:24:03 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1731 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 21:24:03.693529 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0277b0b3-ba4e-4a5b-9025-57a33b8d1df5 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:03.701972 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0277b0b3-ba4e-4a5b-9025-57a33b8d1df5 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1449 microversion: 2.1 time: 0.181963 Sep 06 21:24:03.702469 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 522/1034] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:03 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1449 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:24:04.668546 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-370fe196-3947-4950-b259-47083e26c92c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:04.669585 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-370fe196-3947-4950-b259-47083e26c92c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:04.680957 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-370fe196-3947-4950-b259-47083e26c92c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:04.681532 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-370fe196-3947-4950-b259-47083e26c92c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:04.682095 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-370fe196-3947-4950-b259-47083e26c92c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:04.682844 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-370fe196-3947-4950-b259-47083e26c92c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:04.683317 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-370fe196-3947-4950-b259-47083e26c92c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:04.683738 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-370fe196-3947-4950-b259-47083e26c92c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:04.725939 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2c8e332b-80ae-42fe-b82b-839d0034df29 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:04.726857 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2c8e332b-80ae-42fe-b82b-839d0034df29 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:04.735374 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c8e332b-80ae-42fe-b82b-839d0034df29 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:04.736160 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c8e332b-80ae-42fe-b82b-839d0034df29 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:04.736716 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c8e332b-80ae-42fe-b82b-839d0034df29 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:04.737548 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c8e332b-80ae-42fe-b82b-839d0034df29 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:04.738123 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c8e332b-80ae-42fe-b82b-839d0034df29 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:04.738535 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c8e332b-80ae-42fe-b82b-839d0034df29 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:04.876388 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-370fe196-3947-4950-b259-47083e26c92c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:04.886810 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-370fe196-3947-4950-b259-47083e26c92c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:04.888299 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-370fe196-3947-4950-b259-47083e26c92c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:04.889741 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-370fe196-3947-4950-b259-47083e26c92c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1731 microversion: 2.20 time: 0.227502 Sep 06 21:24:04.891184 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 513/1035] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:24:04 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1731 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:24:04.904156 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2c8e332b-80ae-42fe-b82b-839d0034df29 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:04.928019 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2c8e332b-80ae-42fe-b82b-839d0034df29 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1449 microversion: 2.1 time: 0.206604 Sep 06 21:24:04.936691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 523/1036] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:04 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1449 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:05.921032 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5b6f07ee-1705-4648-ae9d-0a0894dfda7d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:05.922010 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5b6f07ee-1705-4648-ae9d-0a0894dfda7d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:05.928798 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b6f07ee-1705-4648-ae9d-0a0894dfda7d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:05.929288 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b6f07ee-1705-4648-ae9d-0a0894dfda7d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:05.929801 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b6f07ee-1705-4648-ae9d-0a0894dfda7d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:05.930839 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b6f07ee-1705-4648-ae9d-0a0894dfda7d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:05.931345 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b6f07ee-1705-4648-ae9d-0a0894dfda7d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:05.931835 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b6f07ee-1705-4648-ae9d-0a0894dfda7d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:05.954622 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-28fd5d31-82df-4fa2-813b-cdfad10e93e8 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:05.956561 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-28fd5d31-82df-4fa2-813b-cdfad10e93e8 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:05.959050 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:05.964708 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28fd5d31-82df-4fa2-813b-cdfad10e93e8 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:05.965211 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28fd5d31-82df-4fa2-813b-cdfad10e93e8 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:05.965641 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28fd5d31-82df-4fa2-813b-cdfad10e93e8 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:05.966350 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28fd5d31-82df-4fa2-813b-cdfad10e93e8 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:05.966800 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28fd5d31-82df-4fa2-813b-cdfad10e93e8 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:05.967216 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-28fd5d31-82df-4fa2-813b-cdfad10e93e8 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:06.084131 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5b6f07ee-1705-4648-ae9d-0a0894dfda7d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:06.093114 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5b6f07ee-1705-4648-ae9d-0a0894dfda7d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:06.094528 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5b6f07ee-1705-4648-ae9d-0a0894dfda7d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:06.095707 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5b6f07ee-1705-4648-ae9d-0a0894dfda7d tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1731 microversion: 2.20 time: 0.179532 Sep 06 21:24:06.096473 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 514/1037] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:24:05 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:24:06.118401 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-28fd5d31-82df-4fa2-813b-cdfad10e93e8 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:06.126325 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-28fd5d31-82df-4fa2-813b-cdfad10e93e8 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1449 microversion: 2.1 time: 0.175758 Sep 06 21:24:06.126924 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 524/1038] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:05 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1449 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:06.533995 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-b3a8991b-fb4c-4603-a7ed-3b07798974cf req-acc891eb-5733-4bdc-bc4a-2741b736bd6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8066f708-d355-454f-b0fd-7b33e51e265e", "name": "network-vif-plugged", "status": "completed", "tag": "d805515a-5f19-4507-b89b-93b54084b935"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:24:06.546447 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b3a8991b-fb4c-4603-a7ed-3b07798974cf req-acc891eb-5733-4bdc-bc4a-2741b736bd6d service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:06.548144 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b3a8991b-fb4c-4603-a7ed-3b07798974cf req-acc891eb-5733-4bdc-bc4a-2741b736bd6d service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:06.549487 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b3a8991b-fb4c-4603-a7ed-3b07798974cf req-acc891eb-5733-4bdc-bc4a-2741b736bd6d service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:06.566263 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-b3a8991b-fb4c-4603-a7ed-3b07798974cf req-acc891eb-5733-4bdc-bc4a-2741b736bd6d service nova] Creating event network-vif-plugged:d805515a-5f19-4507-b89b-93b54084b935 for instance 8066f708-d355-454f-b0fd-7b33e51e265e on hv-cinder-74915 Sep 06 21:24:06.574949 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-b3a8991b-fb4c-4603-a7ed-3b07798974cf req-acc891eb-5733-4bdc-bc4a-2741b736bd6d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043677 Sep 06 21:24:06.578074 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 515/1039] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:24:07.129689 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-60c3be10-3275-45e5-af87-8db2da0bcacf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:07.130951 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-60c3be10-3275-45e5-af87-8db2da0bcacf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:07.141739 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60c3be10-3275-45e5-af87-8db2da0bcacf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:07.142502 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60c3be10-3275-45e5-af87-8db2da0bcacf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:07.143749 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60c3be10-3275-45e5-af87-8db2da0bcacf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:07.154101 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-de10c146-6049-41de-8098-c8bdf7da1b53 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:07.154640 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-de10c146-6049-41de-8098-c8bdf7da1b53 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:07.157276 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60c3be10-3275-45e5-af87-8db2da0bcacf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:07.157803 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60c3be10-3275-45e5-af87-8db2da0bcacf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:07.158302 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60c3be10-3275-45e5-af87-8db2da0bcacf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:07.181287 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de10c146-6049-41de-8098-c8bdf7da1b53 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:07.181810 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de10c146-6049-41de-8098-c8bdf7da1b53 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:07.182234 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de10c146-6049-41de-8098-c8bdf7da1b53 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:07.189763 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de10c146-6049-41de-8098-c8bdf7da1b53 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:07.190269 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de10c146-6049-41de-8098-c8bdf7da1b53 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:07.190714 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de10c146-6049-41de-8098-c8bdf7da1b53 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:07.459279 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-de10c146-6049-41de-8098-c8bdf7da1b53 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:07.467400 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-de10c146-6049-41de-8098-c8bdf7da1b53 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1449 microversion: 2.1 time: 0.320849 Sep 06 21:24:07.468148 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 516/1040] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:07 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1449 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:24:07.500098 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-60c3be10-3275-45e5-af87-8db2da0bcacf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:07.508803 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-60c3be10-3275-45e5-af87-8db2da0bcacf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:07.510327 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-60c3be10-3275-45e5-af87-8db2da0bcacf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:07.511793 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-60c3be10-3275-45e5-af87-8db2da0bcacf tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1731 microversion: 2.20 time: 0.387799 Sep 06 21:24:07.512579 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 525/1041] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:24:07 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1731 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:24:07.794695 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-3c86fd40-fb10-4135-8320-80c8272b2fdf req-ee3028f3-39c7-48aa-8aa7-7803d4e84759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "340de6d7-883f-4c26-89b1-4f8536aa09e8", "name": "network-vif-deleted", "tag": "e03713ad-150d-4e1c-af49-98c4a6fe49fe"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:24:07.804361 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3c86fd40-fb10-4135-8320-80c8272b2fdf req-ee3028f3-39c7-48aa-8aa7-7803d4e84759 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:07.804856 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3c86fd40-fb10-4135-8320-80c8272b2fdf req-ee3028f3-39c7-48aa-8aa7-7803d4e84759 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:07.805275 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3c86fd40-fb10-4135-8320-80c8272b2fdf req-ee3028f3-39c7-48aa-8aa7-7803d4e84759 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:07.816607 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-3c86fd40-fb10-4135-8320-80c8272b2fdf req-ee3028f3-39c7-48aa-8aa7-7803d4e84759 service nova] Creating event network-vif-deleted:e03713ad-150d-4e1c-af49-98c4a6fe49fe for instance 340de6d7-883f-4c26-89b1-4f8536aa09e8 on hv-cinder-74915 Sep 06 21:24:07.821756 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-3c86fd40-fb10-4135-8320-80c8272b2fdf req-ee3028f3-39c7-48aa-8aa7-7803d4e84759 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030905 Sep 06 21:24:07.822320 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 517/1042] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:24:08.268149 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-edd6bc21-11ef-4eec-a7de-c45e0638e87f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Action: 'create', calling method: .version_select at 0x7f04ce5dfb80>, body: {"keypair": {"name": "tempest-keypair-144612602", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCf0zf0sYHgiyNn6A3oa620zOz96BsNv5Z56ml7V838ddJzW5ESV3p+Uwar7HfYrHydkhOZtQYc6Rzq4mlT98z1wurSnfOqxTlbKvl7PR2xjB2eLl84mSmtKRWXxBh7tkw=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:24:08.284562 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-edd6bc21-11ef-4eec-a7de-c45e0638e87f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Getting quotas for project 0ca0b63bd9224370b45e7cc5e9c68a27. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:24:08.288719 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-edd6bc21-11ef-4eec-a7de-c45e0638e87f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Getting quotas for user e22472efcb9a454688744457cb45eabb and project 0ca0b63bd9224370b45e7cc5e9c68a27. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:24:08.313561 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-edd6bc21-11ef-4eec-a7de-c45e0638e87f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049279 Sep 06 21:24:08.314128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 526/1043] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Sep 6 21:24:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:24:08.492240 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a7af3300-0f4c-4c29-bb79-8eb5446a9010 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:08.493031 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a7af3300-0f4c-4c29-bb79-8eb5446a9010 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:08.500118 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7af3300-0f4c-4c29-bb79-8eb5446a9010 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:08.500739 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7af3300-0f4c-4c29-bb79-8eb5446a9010 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:08.501235 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7af3300-0f4c-4c29-bb79-8eb5446a9010 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:08.501997 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7af3300-0f4c-4c29-bb79-8eb5446a9010 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:08.502608 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7af3300-0f4c-4c29-bb79-8eb5446a9010 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:08.503032 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7af3300-0f4c-4c29-bb79-8eb5446a9010 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:08.539289 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-abee7321-9b90-4b51-a61a-c3ac0c0f0472 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:08.540119 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-abee7321-9b90-4b51-a61a-c3ac0c0f0472 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:08.549349 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abee7321-9b90-4b51-a61a-c3ac0c0f0472 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:08.549843 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abee7321-9b90-4b51-a61a-c3ac0c0f0472 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:08.550302 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abee7321-9b90-4b51-a61a-c3ac0c0f0472 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:08.551007 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abee7321-9b90-4b51-a61a-c3ac0c0f0472 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:08.551711 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abee7321-9b90-4b51-a61a-c3ac0c0f0472 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:08.552684 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abee7321-9b90-4b51-a61a-c3ac0c0f0472 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:08.572443 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a7af3300-0f4c-4c29-bb79-8eb5446a9010 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:08.581399 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a7af3300-0f4c-4c29-bb79-8eb5446a9010 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1219 microversion: 2.1 time: 0.093888 Sep 06 21:24:08.591230 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 518/1044] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:08 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:08.724495 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-abee7321-9b90-4b51-a61a-c3ac0c0f0472 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:08.733542 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-abee7321-9b90-4b51-a61a-c3ac0c0f0472 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:08.735011 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-abee7321-9b90-4b51-a61a-c3ac0c0f0472 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:08.736246 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-abee7321-9b90-4b51-a61a-c3ac0c0f0472 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1731 microversion: 2.20 time: 0.202177 Sep 06 21:24:08.737184 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 527/1045] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:24:08 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1731 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:24:09.605714 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5b29f010-b272-4587-ad5b-2340e24b9516 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:09.606307 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5b29f010-b272-4587-ad5b-2340e24b9516 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:09.608689 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=44 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:09.613951 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b29f010-b272-4587-ad5b-2340e24b9516 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:09.614445 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b29f010-b272-4587-ad5b-2340e24b9516 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:09.614878 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b29f010-b272-4587-ad5b-2340e24b9516 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:09.615586 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b29f010-b272-4587-ad5b-2340e24b9516 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:09.616043 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b29f010-b272-4587-ad5b-2340e24b9516 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:09.616599 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b29f010-b272-4587-ad5b-2340e24b9516 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:09.666258 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d0d5b4c2-d750-4bcb-8d07-f95c6b21a960 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-432841643", "imageRef": "8b4a7612-517c-4711-8637-36b221338f65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1fbc3f3e-7fe7-459b-8f2b-1c8b1d601e7b"}], "security_groups": [{"name": "tempest-securitygroup--212503263"}], "key_name": "tempest-keypair-144612602", "user_data": "}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:24:09.684080 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5b29f010-b272-4587-ad5b-2340e24b9516 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:09.694083 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5b29f010-b272-4587-ad5b-2340e24b9516 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1219 microversion: 2.1 time: 0.093131 Sep 06 21:24:09.694660 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 519/1046] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:09 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:09.762954 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c05372ec-0e3e-4275-b4cf-811540c09132 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:09.763557 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c05372ec-0e3e-4275-b4cf-811540c09132 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:09.769695 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c05372ec-0e3e-4275-b4cf-811540c09132 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:09.770105 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c05372ec-0e3e-4275-b4cf-811540c09132 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:09.770532 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c05372ec-0e3e-4275-b4cf-811540c09132 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:09.771220 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c05372ec-0e3e-4275-b4cf-811540c09132 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:09.771663 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c05372ec-0e3e-4275-b4cf-811540c09132 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:09.772077 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c05372ec-0e3e-4275-b4cf-811540c09132 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:09.782171 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-d0d5b4c2-d750-4bcb-8d07-f95c6b21a960 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] validate_networks() for [('1fbc3f3e-7fe7-459b-8f2b-1c8b1d601e7b', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 21:24:09.906936 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c05372ec-0e3e-4275-b4cf-811540c09132 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:09.915420 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c05372ec-0e3e-4275-b4cf-811540c09132 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:09.916876 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c05372ec-0e3e-4275-b4cf-811540c09132 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:09.918253 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c05372ec-0e3e-4275-b4cf-811540c09132 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1731 microversion: 2.20 time: 0.159444 Sep 06 21:24:09.918807 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 520/1047] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:24:09 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 21:24:10.013895 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f51e3dc3-37ba-4bf6-9694-3e0b18722b57 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:10.014382 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f51e3dc3-37ba-4bf6-9694-3e0b18722b57 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:10.020382 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f51e3dc3-37ba-4bf6-9694-3e0b18722b57 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:10.020831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f51e3dc3-37ba-4bf6-9694-3e0b18722b57 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:10.021261 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f51e3dc3-37ba-4bf6-9694-3e0b18722b57 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:10.021945 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f51e3dc3-37ba-4bf6-9694-3e0b18722b57 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:10.022383 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f51e3dc3-37ba-4bf6-9694-3e0b18722b57 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:10.022792 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f51e3dc3-37ba-4bf6-9694-3e0b18722b57 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:10.046941 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f51e3dc3-37ba-4bf6-9694-3e0b18722b57 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77/ips" status: 200 len: 146 microversion: 2.1 time: 0.126791 Sep 06 21:24:10.047489 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 521/1048] 10.222.0.79 () {58 vars in 1248 bytes} [Tue Sep 6 21:24:09 2022] GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77/ips => generated 146 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:24:10.176034 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-d0d5b4c2-d750-4bcb-8d07-f95c6b21a960 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 21:24:10.176452 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-d0d5b4c2-d750-4bcb-8d07-f95c6b21a960 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 21:24:10.177049 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-d0d5b4c2-d750-4bcb-8d07-f95c6b21a960 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 21:24:10.177446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-d0d5b4c2-d750-4bcb-8d07-f95c6b21a960 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 21:24:10.177902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-d0d5b4c2-d750-4bcb-8d07-f95c6b21a960 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 21:24:10.186743 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0d5b4c2-d750-4bcb-8d07-f95c6b21a960 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:10.187215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0d5b4c2-d750-4bcb-8d07-f95c6b21a960 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:10.187635 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0d5b4c2-d750-4bcb-8d07-f95c6b21a960 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:10.188351 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0d5b4c2-d750-4bcb-8d07-f95c6b21a960 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:10.188820 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0d5b4c2-d750-4bcb-8d07-f95c6b21a960 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:10.189236 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0d5b4c2-d750-4bcb-8d07-f95c6b21a960 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:10.206466 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-d0d5b4c2-d750-4bcb-8d07-f95c6b21a960 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Getting quotas for project 0ca0b63bd9224370b45e7cc5e9c68a27. Resources: {'ram', 'cores', 'instances'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:24:10.210963 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-d0d5b4c2-d750-4bcb-8d07-f95c6b21a960 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Getting quotas for user e22472efcb9a454688744457cb45eabb and project 0ca0b63bd9224370b45e7cc5e9c68a27. Resources: {'ram', 'cores', 'instances'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:24:10.223422 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d0d5b4c2-d750-4bcb-8d07-f95c6b21a960 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 21:24:10.226090 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d0d5b4c2-d750-4bcb-8d07-f95c6b21a960 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 17b54989-ef84-453f-920e-766847e1d0ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8b4a7612-517c-4711-8637-36b221338f65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 21:24:10.276059 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d0d5b4c2-d750-4bcb-8d07-f95c6b21a960 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.614867 Sep 06 21:24:10.277044 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 528/1049] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Sep 6 21:24:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 21:24:10.288560 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-34abe456-ea0c-4858-94f7-530f6081d4ed tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:10.289527 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-34abe456-ea0c-4858-94f7-530f6081d4ed tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 17b54989-ef84-453f-920e-766847e1d0ed] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:10.351455 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-34abe456-ea0c-4858-94f7-530f6081d4ed tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:10.359229 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-34abe456-ea0c-4858-94f7-530f6081d4ed tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed" status: 200 len: 1240 microversion: 2.1 time: 0.074937 Sep 06 21:24:10.360060 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 522/1050] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:10 2022] GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:10.724312 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9b2fb000-fc62-4360-827d-ea6f3e666aaf tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:10.724312 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9b2fb000-fc62-4360-827d-ea6f3e666aaf tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:10.727587 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b2fb000-fc62-4360-827d-ea6f3e666aaf tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:10.728068 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b2fb000-fc62-4360-827d-ea6f3e666aaf tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:10.728504 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b2fb000-fc62-4360-827d-ea6f3e666aaf tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:10.729230 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b2fb000-fc62-4360-827d-ea6f3e666aaf tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:10.729684 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b2fb000-fc62-4360-827d-ea6f3e666aaf tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:10.730112 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b2fb000-fc62-4360-827d-ea6f3e666aaf tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:10.795201 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9b2fb000-fc62-4360-827d-ea6f3e666aaf tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:10.803891 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9b2fb000-fc62-4360-827d-ea6f3e666aaf tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1219 microversion: 2.1 time: 0.090822 Sep 06 21:24:10.804585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 529/1051] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:10 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:10.948115 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1900d008-b65b-47e5-89e3-9a72b905185c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:10.948774 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1900d008-b65b-47e5-89e3-9a72b905185c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:10.956066 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1900d008-b65b-47e5-89e3-9a72b905185c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:10.956545 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1900d008-b65b-47e5-89e3-9a72b905185c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:10.957010 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1900d008-b65b-47e5-89e3-9a72b905185c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:10.957715 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1900d008-b65b-47e5-89e3-9a72b905185c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:10.958160 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1900d008-b65b-47e5-89e3-9a72b905185c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:10.958567 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1900d008-b65b-47e5-89e3-9a72b905185c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:11.103268 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1900d008-b65b-47e5-89e3-9a72b905185c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:11.113441 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1900d008-b65b-47e5-89e3-9a72b905185c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:11.115712 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1900d008-b65b-47e5-89e3-9a72b905185c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:11.117579 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1900d008-b65b-47e5-89e3-9a72b905185c tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1731 microversion: 2.20 time: 0.174941 Sep 06 21:24:11.118426 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 523/1052] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:24:10 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:24:11.382917 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ffe7598e-dab5-4695-8589-e8199932e09b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:11.383871 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ffe7598e-dab5-4695-8589-e8199932e09b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 17b54989-ef84-453f-920e-766847e1d0ed] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:11.390566 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ffe7598e-dab5-4695-8589-e8199932e09b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:11.391100 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ffe7598e-dab5-4695-8589-e8199932e09b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:11.391549 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ffe7598e-dab5-4695-8589-e8199932e09b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:11.392262 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ffe7598e-dab5-4695-8589-e8199932e09b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:11.392783 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ffe7598e-dab5-4695-8589-e8199932e09b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:11.393211 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ffe7598e-dab5-4695-8589-e8199932e09b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:11.461134 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ffe7598e-dab5-4695-8589-e8199932e09b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:11.469301 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ffe7598e-dab5-4695-8589-e8199932e09b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed" status: 200 len: 1244 microversion: 2.1 time: 0.091028 Sep 06 21:24:11.469872 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 530/1053] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:11 2022] GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:11.827621 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6fb85571-05cb-4b0e-b758-9c61f4bd7afe tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:11.828226 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6fb85571-05cb-4b0e-b758-9c61f4bd7afe tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:11.835539 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6fb85571-05cb-4b0e-b758-9c61f4bd7afe tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:11.836026 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6fb85571-05cb-4b0e-b758-9c61f4bd7afe tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:11.836454 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6fb85571-05cb-4b0e-b758-9c61f4bd7afe tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:11.837228 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6fb85571-05cb-4b0e-b758-9c61f4bd7afe tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:11.837671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6fb85571-05cb-4b0e-b758-9c61f4bd7afe tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:11.838090 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6fb85571-05cb-4b0e-b758-9c61f4bd7afe tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:11.903152 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6fb85571-05cb-4b0e-b758-9c61f4bd7afe tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:11.911236 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6fb85571-05cb-4b0e-b758-9c61f4bd7afe tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1219 microversion: 2.1 time: 0.087594 Sep 06 21:24:11.911810 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 524/1054] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:11 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:12.151128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6fffb454-6503-4cd1-be55-660a62e086aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:12.151729 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6fffb454-6503-4cd1-be55-660a62e086aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:12.159051 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6fffb454-6503-4cd1-be55-660a62e086aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:12.160210 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6fffb454-6503-4cd1-be55-660a62e086aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:12.160832 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6fffb454-6503-4cd1-be55-660a62e086aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:12.161556 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6fffb454-6503-4cd1-be55-660a62e086aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:12.162019 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6fffb454-6503-4cd1-be55-660a62e086aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:12.162448 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6fffb454-6503-4cd1-be55-660a62e086aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:12.309834 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6fffb454-6503-4cd1-be55-660a62e086aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:12.322682 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6fffb454-6503-4cd1-be55-660a62e086aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:12.325081 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6fffb454-6503-4cd1-be55-660a62e086aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:12.326910 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6fffb454-6503-4cd1-be55-660a62e086aa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1731 microversion: 2.20 time: 0.180830 Sep 06 21:24:12.327785 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 531/1055] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:24:12 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:24:12.492984 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3d5b4c78-f632-42e5-be74-a05a06f9160e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:12.493753 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3d5b4c78-f632-42e5-be74-a05a06f9160e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 17b54989-ef84-453f-920e-766847e1d0ed] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:12.500544 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d5b4c78-f632-42e5-be74-a05a06f9160e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:12.501055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d5b4c78-f632-42e5-be74-a05a06f9160e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:12.501488 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d5b4c78-f632-42e5-be74-a05a06f9160e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:12.502181 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d5b4c78-f632-42e5-be74-a05a06f9160e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:12.502626 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d5b4c78-f632-42e5-be74-a05a06f9160e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:12.503045 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d5b4c78-f632-42e5-be74-a05a06f9160e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:12.565865 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3d5b4c78-f632-42e5-be74-a05a06f9160e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:12.574170 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3d5b4c78-f632-42e5-be74-a05a06f9160e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed" status: 200 len: 1244 microversion: 2.1 time: 0.085180 Sep 06 21:24:12.574743 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 525/1056] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:12 2022] GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:12.935212 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cab2c404-192f-47eb-b1bb-644d23817dea tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:12.935794 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cab2c404-192f-47eb-b1bb-644d23817dea tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:12.942330 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cab2c404-192f-47eb-b1bb-644d23817dea tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:12.942825 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cab2c404-192f-47eb-b1bb-644d23817dea tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:12.943254 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cab2c404-192f-47eb-b1bb-644d23817dea tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:12.943958 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cab2c404-192f-47eb-b1bb-644d23817dea tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:12.944416 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cab2c404-192f-47eb-b1bb-644d23817dea tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:12.944860 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cab2c404-192f-47eb-b1bb-644d23817dea tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:13.006764 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-cab2c404-192f-47eb-b1bb-644d23817dea tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:13.014592 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cab2c404-192f-47eb-b1bb-644d23817dea tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1219 microversion: 2.1 time: 0.083446 Sep 06 21:24:13.015162 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 532/1057] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:12 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:13.356924 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f5c49e97-8f87-4dea-99e8-ffb7db1aacaa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:13.357822 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f5c49e97-8f87-4dea-99e8-ffb7db1aacaa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:13.366216 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5c49e97-8f87-4dea-99e8-ffb7db1aacaa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:13.367196 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5c49e97-8f87-4dea-99e8-ffb7db1aacaa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:13.367880 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5c49e97-8f87-4dea-99e8-ffb7db1aacaa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:13.368918 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5c49e97-8f87-4dea-99e8-ffb7db1aacaa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:13.369365 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5c49e97-8f87-4dea-99e8-ffb7db1aacaa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:13.369773 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5c49e97-8f87-4dea-99e8-ffb7db1aacaa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:13.518321 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f5c49e97-8f87-4dea-99e8-ffb7db1aacaa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:13.525791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2eea6a3b-5c8c-4753-95c4-321da2052940 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ba0e920-5add-4125-a2c7-bf45b2ec93af"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:24:13.527651 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f5c49e97-8f87-4dea-99e8-ffb7db1aacaa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:13.528240 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2eea6a3b-5c8c-4753-95c4-321da2052940 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:13.529397 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f5c49e97-8f87-4dea-99e8-ffb7db1aacaa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:13.530574 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f5c49e97-8f87-4dea-99e8-ffb7db1aacaa tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1731 microversion: 2.20 time: 0.178904 Sep 06 21:24:13.531326 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 526/1058] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:24:13 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:24:13.535154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2eea6a3b-5c8c-4753-95c4-321da2052940 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:13.535639 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2eea6a3b-5c8c-4753-95c4-321da2052940 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:13.536072 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2eea6a3b-5c8c-4753-95c4-321da2052940 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:13.536795 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2eea6a3b-5c8c-4753-95c4-321da2052940 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:13.537256 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2eea6a3b-5c8c-4753-95c4-321da2052940 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:13.537676 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2eea6a3b-5c8c-4753-95c4-321da2052940 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:13.596786 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-79333e6d-61d8-4107-a4d6-b5c5118a85a2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:13.597381 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-79333e6d-61d8-4107-a4d6-b5c5118a85a2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 17b54989-ef84-453f-920e-766847e1d0ed] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:13.604017 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79333e6d-61d8-4107-a4d6-b5c5118a85a2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:13.604559 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79333e6d-61d8-4107-a4d6-b5c5118a85a2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:13.605096 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79333e6d-61d8-4107-a4d6-b5c5118a85a2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:13.605880 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79333e6d-61d8-4107-a4d6-b5c5118a85a2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:13.606399 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79333e6d-61d8-4107-a4d6-b5c5118a85a2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:13.606926 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79333e6d-61d8-4107-a4d6-b5c5118a85a2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:13.672586 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-79333e6d-61d8-4107-a4d6-b5c5118a85a2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:13.682338 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-79333e6d-61d8-4107-a4d6-b5c5118a85a2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed" status: 200 len: 1292 microversion: 2.1 time: 0.089694 Sep 06 21:24:13.683006 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 527/1059] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:13 2022] GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed => generated 1292 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:14.038262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-48f6ac1d-d860-4664-9812-adea89423a8c tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:14.038980 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-48f6ac1d-d860-4664-9812-adea89423a8c tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:14.045227 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48f6ac1d-d860-4664-9812-adea89423a8c tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:14.046002 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48f6ac1d-d860-4664-9812-adea89423a8c tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:14.046490 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48f6ac1d-d860-4664-9812-adea89423a8c tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:14.047255 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48f6ac1d-d860-4664-9812-adea89423a8c tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:14.047729 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48f6ac1d-d860-4664-9812-adea89423a8c tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:14.048163 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48f6ac1d-d860-4664-9812-adea89423a8c tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:14.115417 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-48f6ac1d-d860-4664-9812-adea89423a8c tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:14.123504 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-48f6ac1d-d860-4664-9812-adea89423a8c tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1219 microversion: 2.1 time: 0.089154 Sep 06 21:24:14.124104 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 528/1060] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:14 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:14.557281 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d4cc8748-abf1-4b74-8eca-b299faab99fd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:14.558075 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d4cc8748-abf1-4b74-8eca-b299faab99fd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:14.565473 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4cc8748-abf1-4b74-8eca-b299faab99fd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:14.565962 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4cc8748-abf1-4b74-8eca-b299faab99fd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:14.566388 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4cc8748-abf1-4b74-8eca-b299faab99fd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:14.567130 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4cc8748-abf1-4b74-8eca-b299faab99fd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:14.567655 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4cc8748-abf1-4b74-8eca-b299faab99fd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:14.567992 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4cc8748-abf1-4b74-8eca-b299faab99fd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:14.765411 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d4cc8748-abf1-4b74-8eca-b299faab99fd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:14.769304 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2eea6a3b-5c8c-4753-95c4-321da2052940 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "POST /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.246326 Sep 06 21:24:14.770257 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 533/1061] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Sep 6 21:24:13 2022] POST /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77/os-volume_attachments => generated 194 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:24:14.778104 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d4cc8748-abf1-4b74-8eca-b299faab99fd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:14.780028 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d4cc8748-abf1-4b74-8eca-b299faab99fd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:14.781582 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d4cc8748-abf1-4b74-8eca-b299faab99fd tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1731 microversion: 2.20 time: 0.228517 Sep 06 21:24:14.782766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 529/1062] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:24:14 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1731 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:24:14.798880 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4b9256d9-2802-4574-b4ea-d3a91d1b9802 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:14.799908 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4b9256d9-2802-4574-b4ea-d3a91d1b9802 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 17b54989-ef84-453f-920e-766847e1d0ed] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:14.816975 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b9256d9-2802-4574-b4ea-d3a91d1b9802 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:14.819320 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b9256d9-2802-4574-b4ea-d3a91d1b9802 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:14.819612 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b9256d9-2802-4574-b4ea-d3a91d1b9802 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:14.820376 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b9256d9-2802-4574-b4ea-d3a91d1b9802 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:14.820868 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b9256d9-2802-4574-b4ea-d3a91d1b9802 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:14.821330 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b9256d9-2802-4574-b4ea-d3a91d1b9802 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:14.928945 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4b9256d9-2802-4574-b4ea-d3a91d1b9802 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:14.956778 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4b9256d9-2802-4574-b4ea-d3a91d1b9802 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed" status: 200 len: 1310 microversion: 2.1 time: 0.184813 Sep 06 21:24:14.958232 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 534/1063] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:14 2022] GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed => generated 1310 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:15.147874 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d6f4c5d6-11f1-4d73-a2fe-2ac69a5421f3 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:15.148567 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d6f4c5d6-11f1-4d73-a2fe-2ac69a5421f3 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:15.155317 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6f4c5d6-11f1-4d73-a2fe-2ac69a5421f3 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:15.155998 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6f4c5d6-11f1-4d73-a2fe-2ac69a5421f3 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:15.156297 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6f4c5d6-11f1-4d73-a2fe-2ac69a5421f3 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:15.157137 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6f4c5d6-11f1-4d73-a2fe-2ac69a5421f3 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:15.157729 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6f4c5d6-11f1-4d73-a2fe-2ac69a5421f3 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:15.158213 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6f4c5d6-11f1-4d73-a2fe-2ac69a5421f3 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:15.180062 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:15.193813 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6f4c5d6-11f1-4d73-a2fe-2ac69a5421f3 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:15.194417 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6f4c5d6-11f1-4d73-a2fe-2ac69a5421f3 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:15.194934 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6f4c5d6-11f1-4d73-a2fe-2ac69a5421f3 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:15.195573 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-d6f4c5d6-11f1-4d73-a2fe-2ac69a5421f3 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lazy-loading 'fault' on Instance uuid 340de6d7-883f-4c26-89b1-4f8536aa09e8 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:24:15.236952 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d6f4c5d6-11f1-4d73-a2fe-2ac69a5421f3 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62ee769bb4097b02703cca87ee6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd90c9c3a5554874b6b1d2e5d32d11f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:15.245602 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d6f4c5d6-11f1-4d73-a2fe-2ac69a5421f3 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 200 len: 1224 microversion: 2.1 time: 0.102382 Sep 06 21:24:15.259122 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 530/1064] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:15 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 1224 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:15.809944 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b48c5816-bc1b-4509-894a-b03ff3cc5492 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:15.810678 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b48c5816-bc1b-4509-894a-b03ff3cc5492 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:15.817239 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b48c5816-bc1b-4509-894a-b03ff3cc5492 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:15.817713 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b48c5816-bc1b-4509-894a-b03ff3cc5492 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:15.818141 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b48c5816-bc1b-4509-894a-b03ff3cc5492 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:15.818833 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b48c5816-bc1b-4509-894a-b03ff3cc5492 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:15.819287 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b48c5816-bc1b-4509-894a-b03ff3cc5492 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:15.819710 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b48c5816-bc1b-4509-894a-b03ff3cc5492 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:15.983000 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d644947f-ede7-4522-8940-dfb41b29c24d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:15.983648 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d644947f-ede7-4522-8940-dfb41b29c24d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 17b54989-ef84-453f-920e-766847e1d0ed] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:15.990654 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d644947f-ede7-4522-8940-dfb41b29c24d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:15.991123 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d644947f-ede7-4522-8940-dfb41b29c24d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:15.991569 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d644947f-ede7-4522-8940-dfb41b29c24d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:15.992264 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d644947f-ede7-4522-8940-dfb41b29c24d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:15.992734 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d644947f-ede7-4522-8940-dfb41b29c24d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:15.993276 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d644947f-ede7-4522-8940-dfb41b29c24d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:16.086620 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b48c5816-bc1b-4509-894a-b03ff3cc5492 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:16.089585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:16.098348 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b48c5816-bc1b-4509-894a-b03ff3cc5492 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:16.101140 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b48c5816-bc1b-4509-894a-b03ff3cc5492 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:16.102753 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b48c5816-bc1b-4509-894a-b03ff3cc5492 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1718 microversion: 2.20 time: 0.296885 Sep 06 21:24:16.103541 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 535/1065] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:24:15 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1718 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:24:16.136688 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d644947f-ede7-4522-8940-dfb41b29c24d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:16.144926 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d644947f-ede7-4522-8940-dfb41b29c24d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed" status: 200 len: 1365 microversion: 2.1 time: 0.165956 Sep 06 21:24:16.145576 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 531/1066] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:15 2022] GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:24:16.271957 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c1410848-c690-4811-912e-e3352649dd54 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:16.272645 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c1410848-c690-4811-912e-e3352649dd54 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] [instance: 340de6d7-883f-4c26-89b1-4f8536aa09e8] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:16.288164 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c1410848-c690-4811-912e-e3352649dd54 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:16.288649 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c1410848-c690-4811-912e-e3352649dd54 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:16.289102 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c1410848-c690-4811-912e-e3352649dd54 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:16.289805 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c1410848-c690-4811-912e-e3352649dd54 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:16.290352 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c1410848-c690-4811-912e-e3352649dd54 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:16.290779 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c1410848-c690-4811-912e-e3352649dd54 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:16.305748 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-c1410848-c690-4811-912e-e3352649dd54 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] HTTP exception thrown: Instance 340de6d7-883f-4c26-89b1-4f8536aa09e8 could not be found. Sep 06 21:24:16.307611 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c1410848-c690-4811-912e-e3352649dd54 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Request method failure captured: Sep 06 21:24:16.307611 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 HTTP/1.1 Sep 06 21:24:16.307611 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:24:16.307611 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:24:16.307611 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:24:16.307611 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:24:16.307611 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:24:16.307611 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:24:16.307611 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:24:16.307611 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:24:16.307611 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7jjQ414d-E7a3BPimAo9tJUkFHG1WnxBZ_pqTA1cwlSYtBixGuEzHmzykQ8vQScBOviYIKNO27G7X77tNzWfZFG_i32jVALemhE3ci0SfW-U2YkE-ZiS6l8XX75_P1I7iXrGj1Ag-U7CDfoeS9Rf_-sQ38Rtt3hISgPWNJYWFlHnfM Sep 06 21:24:16.307611 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:24:16.307611 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:24:16.307611 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:24:16.307611 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:24:16.307611 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:24:16.307611 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:24:16.307611 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: fd90c9c3a5554874b6b1d2e5d32d11f9 Sep 06 21:24:16.307611 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-TestShelveInstance-1495826514 Sep 06 21:24:16.307611 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:24:16.307611 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:24:16.309261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/fd90c9c3a5554874b6b1d2e5d32d11f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_fd90c9c3a5554874b6b1d2e5d32d11f9", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fd90c9c3a5554874b6b1d2e5d32d11f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fd90c9c3a5554874b6b1d2e5d32d11f9"}]}] Sep 06 21:24:16.309261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-TestShelveInstance-1495826514 Sep 06 21:24:16.309261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: fd90c9c3a5554874b6b1d2e5d32d11f9 Sep 06 21:24:16.309261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestShelveInstance-1495826514 Sep 06 21:24:16.309261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-TestShelveInstance-1495826514-project Sep 06 21:24:16.309261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:24:16.309261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:24:16.309261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: b9d62ee769bb4097b02703cca87ee6f4 Sep 06 21:24:16.309261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-TestShelveInstance-1495826514-project Sep 06 21:24:16.309261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: > Sep 06 21:24:16.309261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Instance 340de6d7-883f-4c26-89b1-4f8536aa09e8 could not be found. Sep 06 21:24:16.309261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'id': '340de6d7-883f-4c26-89b1-4f8536aa09e8'} Sep 06 21:24:16.313688 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:24:16.313688 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:24:16.313688 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:24:16.313688 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:24:16.313688 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:24:16.313688 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:24:16.313688 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:24:16.313688 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:24:16.313688 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:24:16.313688 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:24:16.313688 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 340de6d7-883f-4c26-89b1-4f8536aa09e8 could not be found. Sep 06 21:24:16.313688 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:24:16.313688 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:24:16.313688 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:24:16.313688 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:24:16.313688 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:24:16.313688 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:24:16.313688 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:24:16.313688 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:24:16.313688 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:24:16.315447 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:24:16.315447 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:24:16.315447 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:24:16.315447 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:24:16.315447 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:24:16.315447 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:24:16.315447 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:24:16.315447 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 340de6d7-883f-4c26-89b1-4f8536aa09e8 could not be found. Sep 06 21:24:16.315447 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:24:16.315447 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:24:16.315447 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:24:16.315447 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:24:16.315447 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:24:16.315447 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:24:16.315447 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:24:16.315447 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:24:16.315447 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 340de6d7-883f-4c26-89b1-4f8536aa09e8 could not be found. Sep 06 21:24:16.315447 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:24:16.317290 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c1410848-c690-4811-912e-e3352649dd54 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Returning 404 to user: Instance 340de6d7-883f-4c26-89b1-4f8536aa09e8 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:24:16.317290 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c1410848-c690-4811-912e-e3352649dd54 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8" status: 404 len: 111 microversion: 2.1 time: 0.041227 Sep 06 21:24:16.317290 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 536/1067] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:16 2022] GET /compute/v2.1/servers/340de6d7-883f-4c26-89b1-4f8536aa09e8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:24:16.511898 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bcc696a4-98d9-499d-b552-35e01a290b52 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] Calling method '.version_select at 0x7f04ce47ae50>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:16.532675 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-2ca6a66a-273f-4f0d-b078-67bcce569f0c req-49edef8c-4c51-480c-98c9-68e52f2501f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17b54989-ef84-453f-920e-766847e1d0ed", "tag": "e61442a6-0816-47d9-9fea-4de0c787313b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:24:16.544433 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bcc696a4-98d9-499d-b552-35e01a290b52 tempest-TestShelveInstance-1495826514 tempest-TestShelveInstance-1495826514-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1733900156" status: 202 len: 0 microversion: 2.1 time: 0.040556 Sep 06 21:24:16.545845 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 532/1068] 10.222.0.79 () {58 vars in 1254 bytes} [Tue Sep 6 21:24:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1733900156 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:24:16.553108 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2ca6a66a-273f-4f0d-b078-67bcce569f0c req-49edef8c-4c51-480c-98c9-68e52f2501f3 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:16.554467 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2ca6a66a-273f-4f0d-b078-67bcce569f0c req-49edef8c-4c51-480c-98c9-68e52f2501f3 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:16.554987 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2ca6a66a-273f-4f0d-b078-67bcce569f0c req-49edef8c-4c51-480c-98c9-68e52f2501f3 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:16.573971 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-2ca6a66a-273f-4f0d-b078-67bcce569f0c req-49edef8c-4c51-480c-98c9-68e52f2501f3 service nova] Creating event network-changed:e61442a6-0816-47d9-9fea-4de0c787313b for instance 17b54989-ef84-453f-920e-766847e1d0ed on hv-cinder-74915 Sep 06 21:24:16.579469 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-2ca6a66a-273f-4f0d-b078-67bcce569f0c req-49edef8c-4c51-480c-98c9-68e52f2501f3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052932 Sep 06 21:24:16.580316 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 537/1069] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 21:24:17.169119 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ef261551-52ee-4c8b-a5a8-d827eef37e0d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:17.169683 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ef261551-52ee-4c8b-a5a8-d827eef37e0d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 17b54989-ef84-453f-920e-766847e1d0ed] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:17.176543 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef261551-52ee-4c8b-a5a8-d827eef37e0d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:17.177056 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef261551-52ee-4c8b-a5a8-d827eef37e0d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:17.177480 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef261551-52ee-4c8b-a5a8-d827eef37e0d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:17.178211 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef261551-52ee-4c8b-a5a8-d827eef37e0d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:17.178647 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef261551-52ee-4c8b-a5a8-d827eef37e0d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:17.179217 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef261551-52ee-4c8b-a5a8-d827eef37e0d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:17.664369 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ef261551-52ee-4c8b-a5a8-d827eef37e0d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:17.673028 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ef261551-52ee-4c8b-a5a8-d827eef37e0d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed" status: 200 len: 1365 microversion: 2.1 time: 0.508531 Sep 06 21:24:17.673570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 533/1070] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:17 2022] GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed => generated 1365 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:18.696811 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ed09c004-de0f-4fff-a8f3-2a53a935d16f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:18.698677 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ed09c004-de0f-4fff-a8f3-2a53a935d16f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 17b54989-ef84-453f-920e-766847e1d0ed] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:18.706563 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed09c004-de0f-4fff-a8f3-2a53a935d16f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:18.707085 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed09c004-de0f-4fff-a8f3-2a53a935d16f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:18.707805 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed09c004-de0f-4fff-a8f3-2a53a935d16f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:18.708862 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed09c004-de0f-4fff-a8f3-2a53a935d16f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:18.709536 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed09c004-de0f-4fff-a8f3-2a53a935d16f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:18.710206 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed09c004-de0f-4fff-a8f3-2a53a935d16f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:18.891029 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ed09c004-de0f-4fff-a8f3-2a53a935d16f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:18.899449 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ed09c004-de0f-4fff-a8f3-2a53a935d16f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed" status: 200 len: 1365 microversion: 2.1 time: 0.207063 Sep 06 21:24:18.900858 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 538/1071] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:18 2022] GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:19.665937 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d4044cf-8aaf-44be-a102-4c0644b207b2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1391943452", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1275668507", "security_groups": [{"name": "tempest-secgroup-smoke-925187046"}], "block_device_mapping_v2": [{"uuid": "c53253a7-7b20-4d30-a206-a976f85cd65a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a5bbf437-763d-4024-8517-0795a424e454"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:24:19.788211 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-7d4044cf-8aaf-44be-a102-4c0644b207b2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] validate_networks() for [('a5bbf437-763d-4024-8517-0795a424e454', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 21:24:19.927491 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0d6e720f-4457-4d15-9b63-142543e0fcc6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:19.928390 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0d6e720f-4457-4d15-9b63-142543e0fcc6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 17b54989-ef84-453f-920e-766847e1d0ed] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:19.938835 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d6e720f-4457-4d15-9b63-142543e0fcc6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:19.939906 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d6e720f-4457-4d15-9b63-142543e0fcc6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:19.940936 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d6e720f-4457-4d15-9b63-142543e0fcc6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:19.941780 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d6e720f-4457-4d15-9b63-142543e0fcc6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:19.942273 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d6e720f-4457-4d15-9b63-142543e0fcc6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:19.942892 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d6e720f-4457-4d15-9b63-142543e0fcc6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:20.175008 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0d6e720f-4457-4d15-9b63-142543e0fcc6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:20.187286 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0d6e720f-4457-4d15-9b63-142543e0fcc6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed" status: 200 len: 1365 microversion: 2.1 time: 0.268207 Sep 06 21:24:20.188398 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 539/1072] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:19 2022] GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed => generated 1365 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:20.342846 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7d4044cf-8aaf-44be-a102-4c0644b207b2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 21:24:20.343266 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7d4044cf-8aaf-44be-a102-4c0644b207b2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 21:24:20.343738 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7d4044cf-8aaf-44be-a102-4c0644b207b2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 21:24:20.344149 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7d4044cf-8aaf-44be-a102-4c0644b207b2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 21:24:20.344550 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7d4044cf-8aaf-44be-a102-4c0644b207b2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 21:24:20.355416 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d4044cf-8aaf-44be-a102-4c0644b207b2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:20.356417 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d4044cf-8aaf-44be-a102-4c0644b207b2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:20.357071 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d4044cf-8aaf-44be-a102-4c0644b207b2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:20.357818 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d4044cf-8aaf-44be-a102-4c0644b207b2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:20.358272 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d4044cf-8aaf-44be-a102-4c0644b207b2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:20.358685 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d4044cf-8aaf-44be-a102-4c0644b207b2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:20.377820 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-7d4044cf-8aaf-44be-a102-4c0644b207b2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Getting quotas for project 5801984f41a043daa52dbef9de89df9a. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:24:20.383374 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-7d4044cf-8aaf-44be-a102-4c0644b207b2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Getting quotas for user 6d0c1c510b0a4fa39927f7f92352d034 and project 5801984f41a043daa52dbef9de89df9a. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:24:20.448289 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7d4044cf-8aaf-44be-a102-4c0644b207b2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 21:24:20.450480 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7d4044cf-8aaf-44be-a102-4c0644b207b2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: cff6256a-f769-4f06-bab1-72090c9c4357] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c53253a7-7b20-4d30-a206-a976f85cd65a',volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 21:24:20.631144 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7d4044cf-8aaf-44be-a102-4c0644b207b2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.969081 Sep 06 21:24:20.632414 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 534/1073] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Sep 6 21:24:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 21:24:20.643453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9833a70f-7d09-40e6-9311-0c88caaac7d2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:20.644062 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9833a70f-7d09-40e6-9311-0c88caaac7d2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: cff6256a-f769-4f06-bab1-72090c9c4357] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:20.646082 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:20.646743 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=10 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:20.725063 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9833a70f-7d09-40e6-9311-0c88caaac7d2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:20.733485 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9833a70f-7d09-40e6-9311-0c88caaac7d2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357" status: 200 len: 1095 microversion: 2.1 time: 0.093860 Sep 06 21:24:20.734106 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 540/1074] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:20 2022] GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357 => generated 1095 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:21.212758 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b7f802a7-4dcf-4e99-b8cf-8cfb1e76051d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:21.213355 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b7f802a7-4dcf-4e99-b8cf-8cfb1e76051d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 17b54989-ef84-453f-920e-766847e1d0ed] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:21.220780 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7f802a7-4dcf-4e99-b8cf-8cfb1e76051d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:21.221334 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7f802a7-4dcf-4e99-b8cf-8cfb1e76051d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:21.221711 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7f802a7-4dcf-4e99-b8cf-8cfb1e76051d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:21.223372 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7f802a7-4dcf-4e99-b8cf-8cfb1e76051d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:21.223372 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7f802a7-4dcf-4e99-b8cf-8cfb1e76051d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:21.223372 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7f802a7-4dcf-4e99-b8cf-8cfb1e76051d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:21.487832 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b7f802a7-4dcf-4e99-b8cf-8cfb1e76051d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:21.496252 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b7f802a7-4dcf-4e99-b8cf-8cfb1e76051d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed" status: 200 len: 1365 microversion: 2.1 time: 0.288205 Sep 06 21:24:21.496988 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 535/1075] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:21 2022] GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed => generated 1365 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:24:21.757021 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-697e22b4-73c9-46cf-bed3-969b80f5fc63 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:21.757887 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-697e22b4-73c9-46cf-bed3-969b80f5fc63 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: cff6256a-f769-4f06-bab1-72090c9c4357] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:21.765170 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-697e22b4-73c9-46cf-bed3-969b80f5fc63 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:21.765660 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-697e22b4-73c9-46cf-bed3-969b80f5fc63 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:21.766094 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-697e22b4-73c9-46cf-bed3-969b80f5fc63 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:21.766876 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-697e22b4-73c9-46cf-bed3-969b80f5fc63 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:21.767365 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-697e22b4-73c9-46cf-bed3-969b80f5fc63 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:21.767779 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-697e22b4-73c9-46cf-bed3-969b80f5fc63 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:21.835197 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-697e22b4-73c9-46cf-bed3-969b80f5fc63 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:21.843906 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-697e22b4-73c9-46cf-bed3-969b80f5fc63 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357" status: 200 len: 1193 microversion: 2.1 time: 0.090866 Sep 06 21:24:21.844562 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 541/1076] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:21 2022] GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357 => generated 1193 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:22.520928 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-15e371ba-1d8e-40ab-881d-b2152d14a642 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:22.522300 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-15e371ba-1d8e-40ab-881d-b2152d14a642 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 17b54989-ef84-453f-920e-766847e1d0ed] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:22.530678 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15e371ba-1d8e-40ab-881d-b2152d14a642 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:22.531522 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15e371ba-1d8e-40ab-881d-b2152d14a642 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:22.532206 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15e371ba-1d8e-40ab-881d-b2152d14a642 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:22.533175 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15e371ba-1d8e-40ab-881d-b2152d14a642 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:22.533831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15e371ba-1d8e-40ab-881d-b2152d14a642 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:22.534454 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15e371ba-1d8e-40ab-881d-b2152d14a642 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:22.791477 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-15e371ba-1d8e-40ab-881d-b2152d14a642 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:22.816068 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-15e371ba-1d8e-40ab-881d-b2152d14a642 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed" status: 200 len: 1365 microversion: 2.1 time: 0.298959 Sep 06 21:24:22.816726 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 536/1077] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:22 2022] GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed => generated 1365 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:22.868222 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aee854b5-06b8-4038-9132-9a10af8351cc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:22.870424 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-aee854b5-06b8-4038-9132-9a10af8351cc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: cff6256a-f769-4f06-bab1-72090c9c4357] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:22.878573 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aee854b5-06b8-4038-9132-9a10af8351cc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:22.879480 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aee854b5-06b8-4038-9132-9a10af8351cc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:22.880090 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aee854b5-06b8-4038-9132-9a10af8351cc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:22.881037 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aee854b5-06b8-4038-9132-9a10af8351cc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:22.881982 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aee854b5-06b8-4038-9132-9a10af8351cc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:22.883010 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aee854b5-06b8-4038-9132-9a10af8351cc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:22.974414 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-aee854b5-06b8-4038-9132-9a10af8351cc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:22.988221 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-aee854b5-06b8-4038-9132-9a10af8351cc tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357" status: 200 len: 1211 microversion: 2.1 time: 0.124096 Sep 06 21:24:22.989093 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 542/1078] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:22 2022] GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357 => generated 1211 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:23.843619 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-14daf136-28f1-435e-82b9-5b220c5dd9b8 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:23.845017 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-14daf136-28f1-435e-82b9-5b220c5dd9b8 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 17b54989-ef84-453f-920e-766847e1d0ed] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:23.854985 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14daf136-28f1-435e-82b9-5b220c5dd9b8 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:23.855484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14daf136-28f1-435e-82b9-5b220c5dd9b8 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:23.856180 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14daf136-28f1-435e-82b9-5b220c5dd9b8 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:23.856647 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14daf136-28f1-435e-82b9-5b220c5dd9b8 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:23.857127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14daf136-28f1-435e-82b9-5b220c5dd9b8 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:23.857549 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14daf136-28f1-435e-82b9-5b220c5dd9b8 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:24.028381 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fccd7fd1-7437-47f3-bced-6227f89f6410 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:24.029036 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fccd7fd1-7437-47f3-bced-6227f89f6410 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: cff6256a-f769-4f06-bab1-72090c9c4357] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:24.040578 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fccd7fd1-7437-47f3-bced-6227f89f6410 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:24.041441 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fccd7fd1-7437-47f3-bced-6227f89f6410 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:24.042208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fccd7fd1-7437-47f3-bced-6227f89f6410 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:24.043172 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fccd7fd1-7437-47f3-bced-6227f89f6410 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:24.043871 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fccd7fd1-7437-47f3-bced-6227f89f6410 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:24.044509 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fccd7fd1-7437-47f3-bced-6227f89f6410 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:24.157719 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-14daf136-28f1-435e-82b9-5b220c5dd9b8 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:24.170910 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-14daf136-28f1-435e-82b9-5b220c5dd9b8 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed" status: 200 len: 1365 microversion: 2.1 time: 0.336102 Sep 06 21:24:24.174912 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 537/1079] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:23 2022] GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed => generated 1365 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:24.289453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-fccd7fd1-7437-47f3-bced-6227f89f6410 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:24.298301 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fccd7fd1-7437-47f3-bced-6227f89f6410 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357" status: 200 len: 1278 microversion: 2.1 time: 0.278804 Sep 06 21:24:24.308726 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 543/1080] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:24 2022] GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357 => generated 1278 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:24.475741 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-0091b95a-3c4e-4a27-a84e-3fc69927fea2 req-08226cd1-818f-41a1-9052-a19299f9d31d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cff6256a-f769-4f06-bab1-72090c9c4357", "tag": "f36e6285-5f0f-4ce8-862a-730e9d373c0d"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:24:24.495558 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0091b95a-3c4e-4a27-a84e-3fc69927fea2 req-08226cd1-818f-41a1-9052-a19299f9d31d service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:24.496313 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0091b95a-3c4e-4a27-a84e-3fc69927fea2 req-08226cd1-818f-41a1-9052-a19299f9d31d service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:24.496768 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0091b95a-3c4e-4a27-a84e-3fc69927fea2 req-08226cd1-818f-41a1-9052-a19299f9d31d service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:24.516683 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-0091b95a-3c4e-4a27-a84e-3fc69927fea2 req-08226cd1-818f-41a1-9052-a19299f9d31d service nova] Creating event network-changed:f36e6285-5f0f-4ce8-862a-730e9d373c0d for instance cff6256a-f769-4f06-bab1-72090c9c4357 on hv-cinder-74915 Sep 06 21:24:24.532846 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-0091b95a-3c4e-4a27-a84e-3fc69927fea2 req-08226cd1-818f-41a1-9052-a19299f9d31d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151623 Sep 06 21:24:24.533643 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 538/1081] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:24:25.093156 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-5dc43041-95c6-456e-a12d-701b7bf30dd9 req-355da867-bb50-4feb-967d-77c2d49d7367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17b54989-ef84-453f-920e-766847e1d0ed", "name": "network-vif-plugged", "status": "completed", "tag": "e61442a6-0816-47d9-9fea-4de0c787313b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:24:25.105584 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5dc43041-95c6-456e-a12d-701b7bf30dd9 req-355da867-bb50-4feb-967d-77c2d49d7367 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:25.106299 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5dc43041-95c6-456e-a12d-701b7bf30dd9 req-355da867-bb50-4feb-967d-77c2d49d7367 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:25.107113 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5dc43041-95c6-456e-a12d-701b7bf30dd9 req-355da867-bb50-4feb-967d-77c2d49d7367 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:25.121886 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-5dc43041-95c6-456e-a12d-701b7bf30dd9 req-355da867-bb50-4feb-967d-77c2d49d7367 service nova] Creating event network-vif-plugged:e61442a6-0816-47d9-9fea-4de0c787313b for instance 17b54989-ef84-453f-920e-766847e1d0ed on hv-cinder-74915 Sep 06 21:24:25.128440 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-5dc43041-95c6-456e-a12d-701b7bf30dd9 req-355da867-bb50-4feb-967d-77c2d49d7367 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039076 Sep 06 21:24:25.129492 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 544/1082] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:24:25.198548 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2bde4fa7-8b90-4323-a4fd-94b37535c26c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:25.199457 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2bde4fa7-8b90-4323-a4fd-94b37535c26c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 17b54989-ef84-453f-920e-766847e1d0ed] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:25.210655 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bde4fa7-8b90-4323-a4fd-94b37535c26c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:25.211134 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bde4fa7-8b90-4323-a4fd-94b37535c26c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:25.211619 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bde4fa7-8b90-4323-a4fd-94b37535c26c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:25.213124 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bde4fa7-8b90-4323-a4fd-94b37535c26c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:25.213733 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bde4fa7-8b90-4323-a4fd-94b37535c26c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:25.214295 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bde4fa7-8b90-4323-a4fd-94b37535c26c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:25.323918 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-651c2b89-2b9d-4faf-9844-37c88f23ce78 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:25.324773 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-651c2b89-2b9d-4faf-9844-37c88f23ce78 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: cff6256a-f769-4f06-bab1-72090c9c4357] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:25.332341 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-651c2b89-2b9d-4faf-9844-37c88f23ce78 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:25.332946 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-651c2b89-2b9d-4faf-9844-37c88f23ce78 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:25.333458 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-651c2b89-2b9d-4faf-9844-37c88f23ce78 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:25.334340 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-651c2b89-2b9d-4faf-9844-37c88f23ce78 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:25.334866 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-651c2b89-2b9d-4faf-9844-37c88f23ce78 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:25.335376 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-651c2b89-2b9d-4faf-9844-37c88f23ce78 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:25.404035 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2bde4fa7-8b90-4323-a4fd-94b37535c26c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:25.412532 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2bde4fa7-8b90-4323-a4fd-94b37535c26c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed" status: 200 len: 1365 microversion: 2.1 time: 0.219042 Sep 06 21:24:25.413272 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 539/1083] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:25 2022] GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:25.587429 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-651c2b89-2b9d-4faf-9844-37c88f23ce78 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:25.607995 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-651c2b89-2b9d-4faf-9844-37c88f23ce78 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357" status: 200 len: 1278 microversion: 2.1 time: 0.289686 Sep 06 21:24:25.608709 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 545/1084] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:25 2022] GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357 => generated 1278 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:24:26.436371 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e09337a3-73e8-4578-84ac-19671de2da62 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:26.436952 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e09337a3-73e8-4578-84ac-19671de2da62 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 17b54989-ef84-453f-920e-766847e1d0ed] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:26.443774 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e09337a3-73e8-4578-84ac-19671de2da62 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:26.444254 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e09337a3-73e8-4578-84ac-19671de2da62 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:26.444684 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e09337a3-73e8-4578-84ac-19671de2da62 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:26.445403 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e09337a3-73e8-4578-84ac-19671de2da62 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:26.445825 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e09337a3-73e8-4578-84ac-19671de2da62 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:26.446257 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e09337a3-73e8-4578-84ac-19671de2da62 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:26.582718 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e09337a3-73e8-4578-84ac-19671de2da62 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:26.592949 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e09337a3-73e8-4578-84ac-19671de2da62 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed" status: 200 len: 1365 microversion: 2.1 time: 0.160477 Sep 06 21:24:26.593571 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 540/1085] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:26 2022] GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:26.631353 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-33e41818-a58a-4ab5-83a8-4f06fd0ea68f tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:26.631986 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-33e41818-a58a-4ab5-83a8-4f06fd0ea68f tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: cff6256a-f769-4f06-bab1-72090c9c4357] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:26.639743 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33e41818-a58a-4ab5-83a8-4f06fd0ea68f tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:26.640236 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33e41818-a58a-4ab5-83a8-4f06fd0ea68f tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:26.640704 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33e41818-a58a-4ab5-83a8-4f06fd0ea68f tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:26.641386 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33e41818-a58a-4ab5-83a8-4f06fd0ea68f tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:26.641859 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33e41818-a58a-4ab5-83a8-4f06fd0ea68f tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:26.642279 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33e41818-a58a-4ab5-83a8-4f06fd0ea68f tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:26.805917 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-33e41818-a58a-4ab5-83a8-4f06fd0ea68f tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:26.814579 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-33e41818-a58a-4ab5-83a8-4f06fd0ea68f tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357" status: 200 len: 1278 microversion: 2.1 time: 0.187009 Sep 06 21:24:26.815199 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 546/1086] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:26 2022] GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357 => generated 1278 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:27.616087 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a9ae33f7-5575-4d14-8b32-961efee02211 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:27.616915 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a9ae33f7-5575-4d14-8b32-961efee02211 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 17b54989-ef84-453f-920e-766847e1d0ed] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:27.624022 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9ae33f7-5575-4d14-8b32-961efee02211 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:27.624506 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9ae33f7-5575-4d14-8b32-961efee02211 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:27.624980 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9ae33f7-5575-4d14-8b32-961efee02211 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:27.625691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9ae33f7-5575-4d14-8b32-961efee02211 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:27.626140 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9ae33f7-5575-4d14-8b32-961efee02211 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:27.626560 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9ae33f7-5575-4d14-8b32-961efee02211 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:27.775458 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a9ae33f7-5575-4d14-8b32-961efee02211 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:27.783445 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a9ae33f7-5575-4d14-8b32-961efee02211 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed" status: 200 len: 1555 microversion: 2.1 time: 0.171340 Sep 06 21:24:27.784015 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 541/1087] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:27 2022] GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:27.806481 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-91bfd555-fb87-4eac-b352-63cd2f3a697d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:27.807102 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-91bfd555-fb87-4eac-b352-63cd2f3a697d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 17b54989-ef84-453f-920e-766847e1d0ed] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:27.813847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91bfd555-fb87-4eac-b352-63cd2f3a697d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:27.814319 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91bfd555-fb87-4eac-b352-63cd2f3a697d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:27.814750 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91bfd555-fb87-4eac-b352-63cd2f3a697d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:27.815443 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91bfd555-fb87-4eac-b352-63cd2f3a697d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:27.815882 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91bfd555-fb87-4eac-b352-63cd2f3a697d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:27.816305 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91bfd555-fb87-4eac-b352-63cd2f3a697d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:27.838269 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-47230146-5b31-4bec-8bb0-6b485e64484e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:27.838839 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-47230146-5b31-4bec-8bb0-6b485e64484e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: cff6256a-f769-4f06-bab1-72090c9c4357] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:27.845200 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47230146-5b31-4bec-8bb0-6b485e64484e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:27.845682 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47230146-5b31-4bec-8bb0-6b485e64484e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:27.846152 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47230146-5b31-4bec-8bb0-6b485e64484e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:27.847125 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47230146-5b31-4bec-8bb0-6b485e64484e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:27.847560 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47230146-5b31-4bec-8bb0-6b485e64484e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:27.848107 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47230146-5b31-4bec-8bb0-6b485e64484e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:27.906540 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-91bfd555-fb87-4eac-b352-63cd2f3a697d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104132 Sep 06 21:24:27.907135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 547/1088] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Sep 6 21:24:27 2022] GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 21:24:27.995648 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-47230146-5b31-4bec-8bb0-6b485e64484e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:28.003686 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-47230146-5b31-4bec-8bb0-6b485e64484e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357" status: 200 len: 1278 microversion: 2.1 time: 0.169735 Sep 06 21:24:28.004265 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 542/1089] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:27 2022] GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357 => generated 1278 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:28.863133 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2deece58-beab-41a8-8a19-72a56a232840 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:28.865945 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2deece58-beab-41a8-8a19-72a56a232840 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:28.873768 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2deece58-beab-41a8-8a19-72a56a232840 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:28.873945 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2deece58-beab-41a8-8a19-72a56a232840 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:28.874239 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2deece58-beab-41a8-8a19-72a56a232840 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:28.875397 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2deece58-beab-41a8-8a19-72a56a232840 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:28.876158 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2deece58-beab-41a8-8a19-72a56a232840 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:28.876578 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2deece58-beab-41a8-8a19-72a56a232840 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:28.913341 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2deece58-beab-41a8-8a19-72a56a232840 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055773 Sep 06 21:24:28.914247 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 548/1090] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:24:28 2022] GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:24:28.916626 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-023796d6-a12c-4840-bfcd-af3d00b69071 req-503a0fe5-6b0b-4223-b23a-2cbfc2147c26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17b54989-ef84-453f-920e-766847e1d0ed", "tag": "e61442a6-0816-47d9-9fea-4de0c787313b"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:24:28.925835 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7d0e1627-2002-409f-a34b-0ff0160719c2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:28.926756 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7d0e1627-2002-409f-a34b-0ff0160719c2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:28.928100 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-023796d6-a12c-4840-bfcd-af3d00b69071 req-503a0fe5-6b0b-4223-b23a-2cbfc2147c26 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:28.928416 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-023796d6-a12c-4840-bfcd-af3d00b69071 req-503a0fe5-6b0b-4223-b23a-2cbfc2147c26 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:28.929610 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-023796d6-a12c-4840-bfcd-af3d00b69071 req-503a0fe5-6b0b-4223-b23a-2cbfc2147c26 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:28.938220 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d0e1627-2002-409f-a34b-0ff0160719c2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:28.939844 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d0e1627-2002-409f-a34b-0ff0160719c2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:28.941760 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d0e1627-2002-409f-a34b-0ff0160719c2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:28.942245 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-023796d6-a12c-4840-bfcd-af3d00b69071 req-503a0fe5-6b0b-4223-b23a-2cbfc2147c26 service nova] Creating event network-changed:e61442a6-0816-47d9-9fea-4de0c787313b for instance 17b54989-ef84-453f-920e-766847e1d0ed on hv-cinder-74915 Sep 06 21:24:28.943285 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d0e1627-2002-409f-a34b-0ff0160719c2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:28.944207 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d0e1627-2002-409f-a34b-0ff0160719c2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:28.945061 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d0e1627-2002-409f-a34b-0ff0160719c2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:28.950608 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-023796d6-a12c-4840-bfcd-af3d00b69071 req-503a0fe5-6b0b-4223-b23a-2cbfc2147c26 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038294 Sep 06 21:24:28.951241 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 543/1091] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 21:24:28.980428 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7d0e1627-2002-409f-a34b-0ff0160719c2 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77/os-volume_attachments/6ba0e920-5add-4125-a2c7-bf45b2ec93af" status: 200 len: 194 microversion: 2.1 time: 0.058618 Sep 06 21:24:28.981354 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 549/1092] 10.222.0.79 () {58 vars in 1413 bytes} [Tue Sep 6 21:24:28 2022] GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77/os-volume_attachments/6ba0e920-5add-4125-a2c7-bf45b2ec93af => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:24:29.035648 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c4a0606b-1d80-4a68-8679-6d8bafcd76c5 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:29.037114 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c4a0606b-1d80-4a68-8679-6d8bafcd76c5 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: cff6256a-f769-4f06-bab1-72090c9c4357] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:29.056304 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4a0606b-1d80-4a68-8679-6d8bafcd76c5 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:29.057028 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4a0606b-1d80-4a68-8679-6d8bafcd76c5 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:29.057586 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4a0606b-1d80-4a68-8679-6d8bafcd76c5 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:29.059012 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4a0606b-1d80-4a68-8679-6d8bafcd76c5 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:29.059747 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4a0606b-1d80-4a68-8679-6d8bafcd76c5 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:29.060779 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4a0606b-1d80-4a68-8679-6d8bafcd76c5 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:29.242506 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c4a0606b-1d80-4a68-8679-6d8bafcd76c5 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:29.255506 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c4a0606b-1d80-4a68-8679-6d8bafcd76c5 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357" status: 200 len: 1278 microversion: 2.1 time: 0.230934 Sep 06 21:24:29.274084 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 544/1093] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:29 2022] GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357 => generated 1278 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:30.281021 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-374634ee-d65d-4fa5-96ca-6baa56e32ef0 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:30.281639 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-374634ee-d65d-4fa5-96ca-6baa56e32ef0 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: cff6256a-f769-4f06-bab1-72090c9c4357] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:30.288511 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-374634ee-d65d-4fa5-96ca-6baa56e32ef0 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:30.289035 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-374634ee-d65d-4fa5-96ca-6baa56e32ef0 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:30.289502 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-374634ee-d65d-4fa5-96ca-6baa56e32ef0 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:30.290177 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-374634ee-d65d-4fa5-96ca-6baa56e32ef0 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:30.290625 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-374634ee-d65d-4fa5-96ca-6baa56e32ef0 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:30.291053 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-374634ee-d65d-4fa5-96ca-6baa56e32ef0 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:30.469367 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4fe2682a-6361-402c-8544-521ae4acceb5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d2a6046-5fb2-4595-ae49-e7d8a447ee5c"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:24:30.471792 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4fe2682a-6361-402c-8544-521ae4acceb5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:30.474500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:30.475163 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=8 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:30.481288 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fe2682a-6361-402c-8544-521ae4acceb5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:30.481783 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fe2682a-6361-402c-8544-521ae4acceb5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:30.482223 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fe2682a-6361-402c-8544-521ae4acceb5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:30.482937 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fe2682a-6361-402c-8544-521ae4acceb5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:30.483397 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fe2682a-6361-402c-8544-521ae4acceb5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:30.483810 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fe2682a-6361-402c-8544-521ae4acceb5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:30.729464 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:30.773456 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-374634ee-d65d-4fa5-96ca-6baa56e32ef0 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:30.783170 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-374634ee-d65d-4fa5-96ca-6baa56e32ef0 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357" status: 200 len: 1266 microversion: 2.1 time: 0.506285 Sep 06 21:24:30.784231 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 550/1094] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:30 2022] GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357 => generated 1266 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:30.833406 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4fe2682a-6361-402c-8544-521ae4acceb5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "POST /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.367911 Sep 06 21:24:30.834031 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 545/1095] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Sep 6 21:24:30 2022] POST /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77/os-volume_attachments => generated 194 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:24:31.818144 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f4207016-59ec-4f9a-bbc8-1a65e050f794 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:31.819114 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f4207016-59ec-4f9a-bbc8-1a65e050f794 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: cff6256a-f769-4f06-bab1-72090c9c4357] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:31.829350 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4207016-59ec-4f9a-bbc8-1a65e050f794 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:31.830072 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4207016-59ec-4f9a-bbc8-1a65e050f794 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:31.830723 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4207016-59ec-4f9a-bbc8-1a65e050f794 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:31.831774 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4207016-59ec-4f9a-bbc8-1a65e050f794 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:31.832455 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4207016-59ec-4f9a-bbc8-1a65e050f794 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:31.833134 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4207016-59ec-4f9a-bbc8-1a65e050f794 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:31.974394 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f4207016-59ec-4f9a-bbc8-1a65e050f794 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:31.983459 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f4207016-59ec-4f9a-bbc8-1a65e050f794 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357" status: 200 len: 1266 microversion: 2.1 time: 0.171422 Sep 06 21:24:31.984023 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 551/1096] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:31 2022] GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:33.010606 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4bd91ec3-f932-4566-b52e-480d9664e88a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:33.011359 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4bd91ec3-f932-4566-b52e-480d9664e88a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: cff6256a-f769-4f06-bab1-72090c9c4357] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:33.019520 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bd91ec3-f932-4566-b52e-480d9664e88a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:33.020132 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bd91ec3-f932-4566-b52e-480d9664e88a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:33.020855 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bd91ec3-f932-4566-b52e-480d9664e88a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:33.021805 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bd91ec3-f932-4566-b52e-480d9664e88a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:33.022502 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bd91ec3-f932-4566-b52e-480d9664e88a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:33.023184 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bd91ec3-f932-4566-b52e-480d9664e88a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:33.159032 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4bd91ec3-f932-4566-b52e-480d9664e88a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:33.172550 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4bd91ec3-f932-4566-b52e-480d9664e88a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357" status: 200 len: 1266 microversion: 2.1 time: 0.168532 Sep 06 21:24:33.173492 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 546/1097] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:33 2022] GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:34.200116 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2aede459-ed57-49d9-98fb-9a18fd942711 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:34.200823 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2aede459-ed57-49d9-98fb-9a18fd942711 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: cff6256a-f769-4f06-bab1-72090c9c4357] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:34.207583 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2aede459-ed57-49d9-98fb-9a18fd942711 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:34.208068 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2aede459-ed57-49d9-98fb-9a18fd942711 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:34.208505 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2aede459-ed57-49d9-98fb-9a18fd942711 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:34.209235 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2aede459-ed57-49d9-98fb-9a18fd942711 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:34.209697 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2aede459-ed57-49d9-98fb-9a18fd942711 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:34.210120 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2aede459-ed57-49d9-98fb-9a18fd942711 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:34.348933 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2aede459-ed57-49d9-98fb-9a18fd942711 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:34.359001 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2aede459-ed57-49d9-98fb-9a18fd942711 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357" status: 200 len: 1266 microversion: 2.1 time: 0.162922 Sep 06 21:24:34.359575 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 552/1098] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:34 2022] GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:35.381838 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e4cd1751-9c86-45f8-b79b-7aebf5bd9edf tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:35.382544 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e4cd1751-9c86-45f8-b79b-7aebf5bd9edf tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: cff6256a-f769-4f06-bab1-72090c9c4357] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:35.390559 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4cd1751-9c86-45f8-b79b-7aebf5bd9edf tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:35.391043 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4cd1751-9c86-45f8-b79b-7aebf5bd9edf tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:35.391487 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4cd1751-9c86-45f8-b79b-7aebf5bd9edf tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:35.392188 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4cd1751-9c86-45f8-b79b-7aebf5bd9edf tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:35.392635 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4cd1751-9c86-45f8-b79b-7aebf5bd9edf tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:35.393071 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4cd1751-9c86-45f8-b79b-7aebf5bd9edf tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:35.531109 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e4cd1751-9c86-45f8-b79b-7aebf5bd9edf tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:35.539317 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e4cd1751-9c86-45f8-b79b-7aebf5bd9edf tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357" status: 200 len: 1266 microversion: 2.1 time: 0.161476 Sep 06 21:24:35.539891 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 547/1099] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:35 2022] GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:36.563049 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-caafe8a0-291b-4292-b764-9e6a62d1b8a8 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:36.563657 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-caafe8a0-291b-4292-b764-9e6a62d1b8a8 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: cff6256a-f769-4f06-bab1-72090c9c4357] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:36.566045 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:36.571480 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-caafe8a0-291b-4292-b764-9e6a62d1b8a8 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:36.571958 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-caafe8a0-291b-4292-b764-9e6a62d1b8a8 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:36.572393 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-caafe8a0-291b-4292-b764-9e6a62d1b8a8 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:36.573132 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-caafe8a0-291b-4292-b764-9e6a62d1b8a8 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:36.573580 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-caafe8a0-291b-4292-b764-9e6a62d1b8a8 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:36.574004 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-caafe8a0-291b-4292-b764-9e6a62d1b8a8 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:36.711483 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-caafe8a0-291b-4292-b764-9e6a62d1b8a8 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:36.719524 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-caafe8a0-291b-4292-b764-9e6a62d1b8a8 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357" status: 200 len: 1266 microversion: 2.1 time: 0.160467 Sep 06 21:24:36.720166 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 553/1100] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:36 2022] GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:37.742293 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a8531b28-4dbf-45af-ab5d-57717aa11348 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:37.742896 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a8531b28-4dbf-45af-ab5d-57717aa11348 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: cff6256a-f769-4f06-bab1-72090c9c4357] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:37.749947 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8531b28-4dbf-45af-ab5d-57717aa11348 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:37.750421 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8531b28-4dbf-45af-ab5d-57717aa11348 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:37.750845 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8531b28-4dbf-45af-ab5d-57717aa11348 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:37.751531 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8531b28-4dbf-45af-ab5d-57717aa11348 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:37.751974 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8531b28-4dbf-45af-ab5d-57717aa11348 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:37.752388 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8531b28-4dbf-45af-ab5d-57717aa11348 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:37.771847 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:37.887153 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a8531b28-4dbf-45af-ab5d-57717aa11348 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:37.895224 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a8531b28-4dbf-45af-ab5d-57717aa11348 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357" status: 200 len: 1266 microversion: 2.1 time: 0.156893 Sep 06 21:24:37.896046 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 548/1101] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:37 2022] GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:38.422093 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3bd27b1e-bc46-4632-b853-a0b2bcac4643 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:38.424317 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3bd27b1e-bc46-4632-b853-a0b2bcac4643 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:38.431161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3bd27b1e-bc46-4632-b853-a0b2bcac4643 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:38.431642 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3bd27b1e-bc46-4632-b853-a0b2bcac4643 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:38.432071 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3bd27b1e-bc46-4632-b853-a0b2bcac4643 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:38.432798 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3bd27b1e-bc46-4632-b853-a0b2bcac4643 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:38.433249 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3bd27b1e-bc46-4632-b853-a0b2bcac4643 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:38.433664 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3bd27b1e-bc46-4632-b853-a0b2bcac4643 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:38.466267 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3bd27b1e-bc46-4632-b853-a0b2bcac4643 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048437 Sep 06 21:24:38.466826 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 554/1102] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:24:38 2022] GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:24:38.607681 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4eb760f5-d814-453f-b8c1-fb6f1192e92c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:38.608196 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4eb760f5-d814-453f-b8c1-fb6f1192e92c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:38.614683 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4eb760f5-d814-453f-b8c1-fb6f1192e92c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:38.615142 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4eb760f5-d814-453f-b8c1-fb6f1192e92c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:38.615563 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4eb760f5-d814-453f-b8c1-fb6f1192e92c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:38.616296 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4eb760f5-d814-453f-b8c1-fb6f1192e92c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:38.616768 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4eb760f5-d814-453f-b8c1-fb6f1192e92c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:38.617182 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4eb760f5-d814-453f-b8c1-fb6f1192e92c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:38.655532 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4eb760f5-d814-453f-b8c1-fb6f1192e92c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77/os-volume_attachments/6ba0e920-5add-4125-a2c7-bf45b2ec93af" status: 200 len: 194 microversion: 2.1 time: 0.051904 Sep 06 21:24:38.656062 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 549/1103] 10.222.0.79 () {58 vars in 1413 bytes} [Tue Sep 6 21:24:38 2022] GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77/os-volume_attachments/6ba0e920-5add-4125-a2c7-bf45b2ec93af => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:24:38.666865 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-71c3184f-a83d-45ad-9ca0-769faadacb5b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:38.667349 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-71c3184f-a83d-45ad-9ca0-769faadacb5b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:38.674319 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71c3184f-a83d-45ad-9ca0-769faadacb5b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:38.674801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71c3184f-a83d-45ad-9ca0-769faadacb5b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:38.675232 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71c3184f-a83d-45ad-9ca0-769faadacb5b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:38.675927 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71c3184f-a83d-45ad-9ca0-769faadacb5b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:38.676374 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71c3184f-a83d-45ad-9ca0-769faadacb5b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:38.676821 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71c3184f-a83d-45ad-9ca0-769faadacb5b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:38.754174 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:38.760183 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-71c3184f-a83d-45ad-9ca0-769faadacb5b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lazy-loading 'services' on Instance uuid 7c8fa97e-9971-4d57-8284-386f235d2a77 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:24:38.833977 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-71c3184f-a83d-45ad-9ca0-769faadacb5b tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77/os-volume_attachments/6ba0e920-5add-4125-a2c7-bf45b2ec93af" status: 202 len: 0 microversion: 2.1 time: 0.171008 Sep 06 21:24:38.834810 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 555/1104] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Sep 6 21:24:38 2022] DELETE /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77/os-volume_attachments/6ba0e920-5add-4125-a2c7-bf45b2ec93af => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:24:38.917568 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3cd7e69f-ecf7-40cd-aba7-8befa4c1fba7 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:38.918746 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3cd7e69f-ecf7-40cd-aba7-8befa4c1fba7 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: cff6256a-f769-4f06-bab1-72090c9c4357] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:38.925981 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3cd7e69f-ecf7-40cd-aba7-8befa4c1fba7 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:38.926460 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3cd7e69f-ecf7-40cd-aba7-8befa4c1fba7 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:38.926890 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3cd7e69f-ecf7-40cd-aba7-8befa4c1fba7 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:38.927586 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3cd7e69f-ecf7-40cd-aba7-8befa4c1fba7 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:38.928029 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3cd7e69f-ecf7-40cd-aba7-8befa4c1fba7 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:38.929273 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3cd7e69f-ecf7-40cd-aba7-8befa4c1fba7 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:39.069083 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3cd7e69f-ecf7-40cd-aba7-8befa4c1fba7 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:39.077282 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3cd7e69f-ecf7-40cd-aba7-8befa4c1fba7 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357" status: 200 len: 1266 microversion: 2.1 time: 0.163607 Sep 06 21:24:39.077853 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 550/1105] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:38 2022] GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:40.101027 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b3e800b6-8fdb-4eea-8f4b-00ff99972a18 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:40.101738 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b3e800b6-8fdb-4eea-8f4b-00ff99972a18 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: cff6256a-f769-4f06-bab1-72090c9c4357] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:40.109074 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3e800b6-8fdb-4eea-8f4b-00ff99972a18 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:40.109550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3e800b6-8fdb-4eea-8f4b-00ff99972a18 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:40.109975 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3e800b6-8fdb-4eea-8f4b-00ff99972a18 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:40.110668 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3e800b6-8fdb-4eea-8f4b-00ff99972a18 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:40.111115 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3e800b6-8fdb-4eea-8f4b-00ff99972a18 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:40.111533 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3e800b6-8fdb-4eea-8f4b-00ff99972a18 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:40.248450 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b3e800b6-8fdb-4eea-8f4b-00ff99972a18 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:40.256890 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b3e800b6-8fdb-4eea-8f4b-00ff99972a18 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357" status: 200 len: 1266 microversion: 2.1 time: 0.160675 Sep 06 21:24:40.257459 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 556/1106] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:40 2022] GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:41.031348 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d6be5eed-5063-4bc0-a54e-c826354b6aa0 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:41.031888 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d6be5eed-5063-4bc0-a54e-c826354b6aa0 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:41.034417 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:41.039882 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6be5eed-5063-4bc0-a54e-c826354b6aa0 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:41.040364 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6be5eed-5063-4bc0-a54e-c826354b6aa0 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:41.040818 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6be5eed-5063-4bc0-a54e-c826354b6aa0 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:41.041513 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6be5eed-5063-4bc0-a54e-c826354b6aa0 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:41.041951 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6be5eed-5063-4bc0-a54e-c826354b6aa0 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:41.042368 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6be5eed-5063-4bc0-a54e-c826354b6aa0 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:41.065903 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-562d2e1d-c3c1-4dcc-9ddc-f41f427d966e req-948112ff-c58b-4fd1-b266-ddc07c9aa483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cff6256a-f769-4f06-bab1-72090c9c4357", "name": "network-vif-plugged", "status": "completed", "tag": "f36e6285-5f0f-4ce8-862a-730e9d373c0d"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:24:41.076728 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d6be5eed-5063-4bc0-a54e-c826354b6aa0 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77/os-volume_attachments/8d2a6046-5fb2-4595-ae49-e7d8a447ee5c" status: 200 len: 194 microversion: 2.1 time: 0.049515 Sep 06 21:24:41.077340 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 551/1107] 10.222.0.79 () {58 vars in 1413 bytes} [Tue Sep 6 21:24:41 2022] GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77/os-volume_attachments/8d2a6046-5fb2-4595-ae49-e7d8a447ee5c => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:24:41.077802 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-562d2e1d-c3c1-4dcc-9ddc-f41f427d966e req-948112ff-c58b-4fd1-b266-ddc07c9aa483 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:41.078488 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-562d2e1d-c3c1-4dcc-9ddc-f41f427d966e req-948112ff-c58b-4fd1-b266-ddc07c9aa483 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:41.078919 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-562d2e1d-c3c1-4dcc-9ddc-f41f427d966e req-948112ff-c58b-4fd1-b266-ddc07c9aa483 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:41.088256 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-407c52c7-86b4-4cd5-8a7f-a52843c1accc tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:41.088769 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-407c52c7-86b4-4cd5-8a7f-a52843c1accc tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:41.091343 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-562d2e1d-c3c1-4dcc-9ddc-f41f427d966e req-948112ff-c58b-4fd1-b266-ddc07c9aa483 service nova] Creating event network-vif-plugged:f36e6285-5f0f-4ce8-862a-730e9d373c0d for instance cff6256a-f769-4f06-bab1-72090c9c4357 on hv-cinder-74915 Sep 06 21:24:41.095466 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-407c52c7-86b4-4cd5-8a7f-a52843c1accc tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:41.095953 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-407c52c7-86b4-4cd5-8a7f-a52843c1accc tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:41.096381 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-407c52c7-86b4-4cd5-8a7f-a52843c1accc tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:41.096534 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-562d2e1d-c3c1-4dcc-9ddc-f41f427d966e req-948112ff-c58b-4fd1-b266-ddc07c9aa483 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034399 Sep 06 21:24:41.097106 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-407c52c7-86b4-4cd5-8a7f-a52843c1accc tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:41.097242 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 557/1108] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:24:41.097914 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-407c52c7-86b4-4cd5-8a7f-a52843c1accc tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:41.098314 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-407c52c7-86b4-4cd5-8a7f-a52843c1accc tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:41.181472 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-407c52c7-86b4-4cd5-8a7f-a52843c1accc tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lazy-loading 'services' on Instance uuid 7c8fa97e-9971-4d57-8284-386f235d2a77 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:24:41.255029 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-407c52c7-86b4-4cd5-8a7f-a52843c1accc tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77/os-volume_attachments/8d2a6046-5fb2-4595-ae49-e7d8a447ee5c" status: 202 len: 0 microversion: 2.1 time: 0.170554 Sep 06 21:24:41.255707 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 552/1109] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Sep 6 21:24:41 2022] DELETE /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77/os-volume_attachments/8d2a6046-5fb2-4595-ae49-e7d8a447ee5c => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:24:41.282606 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5365ca82-93f7-4514-8094-518cde459305 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:41.284226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5365ca82-93f7-4514-8094-518cde459305 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: cff6256a-f769-4f06-bab1-72090c9c4357] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:41.290737 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5365ca82-93f7-4514-8094-518cde459305 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:41.291214 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5365ca82-93f7-4514-8094-518cde459305 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:41.291640 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5365ca82-93f7-4514-8094-518cde459305 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:41.292353 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5365ca82-93f7-4514-8094-518cde459305 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:41.292830 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5365ca82-93f7-4514-8094-518cde459305 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:41.293555 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5365ca82-93f7-4514-8094-518cde459305 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:41.470206 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5365ca82-93f7-4514-8094-518cde459305 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:41.478623 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5365ca82-93f7-4514-8094-518cde459305 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357" status: 200 len: 1266 microversion: 2.1 time: 0.202774 Sep 06 21:24:41.479190 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 558/1110] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:41 2022] GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:42.501917 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9fd4bc16-efca-4248-98e1-71be7c6e03e4 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:42.502614 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9fd4bc16-efca-4248-98e1-71be7c6e03e4 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: cff6256a-f769-4f06-bab1-72090c9c4357] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:42.509598 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fd4bc16-efca-4248-98e1-71be7c6e03e4 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:42.510061 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fd4bc16-efca-4248-98e1-71be7c6e03e4 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:42.510494 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fd4bc16-efca-4248-98e1-71be7c6e03e4 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:42.511190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fd4bc16-efca-4248-98e1-71be7c6e03e4 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:42.511638 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fd4bc16-efca-4248-98e1-71be7c6e03e4 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:42.512061 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fd4bc16-efca-4248-98e1-71be7c6e03e4 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:42.645307 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9fd4bc16-efca-4248-98e1-71be7c6e03e4 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:42.653665 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9fd4bc16-efca-4248-98e1-71be7c6e03e4 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357" status: 200 len: 1266 microversion: 2.1 time: 0.156264 Sep 06 21:24:42.654248 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 553/1111] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:42 2022] GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:43.532098 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-947176aa-3887-4624-9d7c-93699caf9dc7 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:43.534351 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-947176aa-3887-4624-9d7c-93699caf9dc7 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:43.541172 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-947176aa-3887-4624-9d7c-93699caf9dc7 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:43.541651 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-947176aa-3887-4624-9d7c-93699caf9dc7 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:43.542086 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-947176aa-3887-4624-9d7c-93699caf9dc7 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:43.542801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-947176aa-3887-4624-9d7c-93699caf9dc7 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:43.543249 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-947176aa-3887-4624-9d7c-93699caf9dc7 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:43.543685 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-947176aa-3887-4624-9d7c-93699caf9dc7 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:43.575577 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-947176aa-3887-4624-9d7c-93699caf9dc7 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047605 Sep 06 21:24:43.576155 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 559/1112] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:24:43 2022] GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 21:24:43.676911 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-42c86e0f-77f5-4338-9333-809ab6eb9bae tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:43.677519 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-42c86e0f-77f5-4338-9333-809ab6eb9bae tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: cff6256a-f769-4f06-bab1-72090c9c4357] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:43.684340 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42c86e0f-77f5-4338-9333-809ab6eb9bae tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:43.684931 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42c86e0f-77f5-4338-9333-809ab6eb9bae tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:43.685364 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42c86e0f-77f5-4338-9333-809ab6eb9bae tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:43.686085 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42c86e0f-77f5-4338-9333-809ab6eb9bae tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:43.686531 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42c86e0f-77f5-4338-9333-809ab6eb9bae tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:43.686947 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42c86e0f-77f5-4338-9333-809ab6eb9bae tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:43.696071 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5954c35d-9e9f-4902-a83f-8f7a4716b22e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:43.698344 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5954c35d-9e9f-4902-a83f-8f7a4716b22e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:43.705106 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5954c35d-9e9f-4902-a83f-8f7a4716b22e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:43.705600 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5954c35d-9e9f-4902-a83f-8f7a4716b22e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:43.706034 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5954c35d-9e9f-4902-a83f-8f7a4716b22e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:43.706754 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5954c35d-9e9f-4902-a83f-8f7a4716b22e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:43.707208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5954c35d-9e9f-4902-a83f-8f7a4716b22e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:43.707622 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5954c35d-9e9f-4902-a83f-8f7a4716b22e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:43.738159 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5954c35d-9e9f-4902-a83f-8f7a4716b22e tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046331 Sep 06 21:24:43.738731 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 560/1113] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:24:43 2022] GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 21:24:43.803578 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dae6155f-515d-45ca-b3de-bd2fdfde69f5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:43.804218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dae6155f-515d-45ca-b3de-bd2fdfde69f5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:43.811063 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dae6155f-515d-45ca-b3de-bd2fdfde69f5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:43.811557 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dae6155f-515d-45ca-b3de-bd2fdfde69f5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:43.811989 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dae6155f-515d-45ca-b3de-bd2fdfde69f5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:43.812785 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dae6155f-515d-45ca-b3de-bd2fdfde69f5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:43.813337 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dae6155f-515d-45ca-b3de-bd2fdfde69f5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:43.813889 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dae6155f-515d-45ca-b3de-bd2fdfde69f5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:43.823547 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-42c86e0f-77f5-4338-9333-809ab6eb9bae tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:43.831946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-42c86e0f-77f5-4338-9333-809ab6eb9bae tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357" status: 200 len: 1453 microversion: 2.1 time: 0.158891 Sep 06 21:24:43.832519 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 554/1114] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:43 2022] GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:43.840994 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dae6155f-515d-45ca-b3de-bd2fdfde69f5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 21:24:43.855007 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-29c18d10-33cc-4a43-ab8f-240c1c59aad3 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:43.855638 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-29c18d10-33cc-4a43-ab8f-240c1c59aad3 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: cff6256a-f769-4f06-bab1-72090c9c4357] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:43.862201 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29c18d10-33cc-4a43-ab8f-240c1c59aad3 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:43.862753 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29c18d10-33cc-4a43-ab8f-240c1c59aad3 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:43.863264 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29c18d10-33cc-4a43-ab8f-240c1c59aad3 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:43.864139 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29c18d10-33cc-4a43-ab8f-240c1c59aad3 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:43.864692 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29c18d10-33cc-4a43-ab8f-240c1c59aad3 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:43.865165 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29c18d10-33cc-4a43-ab8f-240c1c59aad3 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:43.922214 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dae6155f-515d-45ca-b3de-bd2fdfde69f5 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77" status: 204 len: 0 microversion: 2.1 time: 0.122749 Sep 06 21:24:43.922807 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 561/1115] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Sep 6 21:24:43 2022] DELETE /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 21:24:43.931464 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-868c2ad2-c246-437f-b2fc-3678d19f397d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:43.932149 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-868c2ad2-c246-437f-b2fc-3678d19f397d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:43.938228 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-868c2ad2-c246-437f-b2fc-3678d19f397d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:43.938698 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-868c2ad2-c246-437f-b2fc-3678d19f397d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:43.939122 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-868c2ad2-c246-437f-b2fc-3678d19f397d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:43.939806 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-868c2ad2-c246-437f-b2fc-3678d19f397d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:43.940250 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-868c2ad2-c246-437f-b2fc-3678d19f397d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:43.940682 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-868c2ad2-c246-437f-b2fc-3678d19f397d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:44.004063 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-29c18d10-33cc-4a43-ab8f-240c1c59aad3 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:44.012052 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-29c18d10-33cc-4a43-ab8f-240c1c59aad3 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357" status: 200 len: 1453 microversion: 2.1 time: 0.161278 Sep 06 21:24:44.012784 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 555/1116] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:43 2022] GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357 => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:44.079758 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-868c2ad2-c246-437f-b2fc-3678d19f397d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:44.090841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-868c2ad2-c246-437f-b2fc-3678d19f397d tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77" status: 200 len: 1674 microversion: 2.1 time: 0.163440 Sep 06 21:24:44.091694 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 562/1117] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:43 2022] GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:24:45.114734 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fe97cd72-3e46-46ed-be3e-551588d0e295 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:45.115332 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fe97cd72-3e46-46ed-be3e-551588d0e295 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:45.122600 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe97cd72-3e46-46ed-be3e-551588d0e295 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:45.123083 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe97cd72-3e46-46ed-be3e-551588d0e295 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:45.123521 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe97cd72-3e46-46ed-be3e-551588d0e295 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:45.124214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe97cd72-3e46-46ed-be3e-551588d0e295 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:45.124685 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe97cd72-3e46-46ed-be3e-551588d0e295 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:45.125107 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe97cd72-3e46-46ed-be3e-551588d0e295 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:45.323602 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fe97cd72-3e46-46ed-be3e-551588d0e295 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:45.332734 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fe97cd72-3e46-46ed-be3e-551588d0e295 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77" status: 200 len: 1674 microversion: 2.1 time: 0.221834 Sep 06 21:24:45.333334 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 556/1118] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:45 2022] GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77 => generated 1674 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:46.206943 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-b9dd2912-c652-438a-bc6c-b55c8b2a1df8 req-03a92f3d-8559-4bb9-855a-47861fb39ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cff6256a-f769-4f06-bab1-72090c9c4357", "tag": "f36e6285-5f0f-4ce8-862a-730e9d373c0d"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:24:46.217519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b9dd2912-c652-438a-bc6c-b55c8b2a1df8 req-03a92f3d-8559-4bb9-855a-47861fb39ca2 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:46.217987 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b9dd2912-c652-438a-bc6c-b55c8b2a1df8 req-03a92f3d-8559-4bb9-855a-47861fb39ca2 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:46.218407 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b9dd2912-c652-438a-bc6c-b55c8b2a1df8 req-03a92f3d-8559-4bb9-855a-47861fb39ca2 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:46.230122 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-b9dd2912-c652-438a-bc6c-b55c8b2a1df8 req-03a92f3d-8559-4bb9-855a-47861fb39ca2 service nova] Creating event network-changed:f36e6285-5f0f-4ce8-862a-730e9d373c0d for instance cff6256a-f769-4f06-bab1-72090c9c4357 on hv-cinder-74915 Sep 06 21:24:46.235352 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-b9dd2912-c652-438a-bc6c-b55c8b2a1df8 req-03a92f3d-8559-4bb9-855a-47861fb39ca2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032317 Sep 06 21:24:46.235951 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 563/1119] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:24:46.357620 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-42f2a94b-8f57-4c4b-989c-e4a0eac20447 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:46.358365 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-42f2a94b-8f57-4c4b-989c-e4a0eac20447 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:46.367325 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42f2a94b-8f57-4c4b-989c-e4a0eac20447 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:46.368019 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42f2a94b-8f57-4c4b-989c-e4a0eac20447 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:46.369064 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42f2a94b-8f57-4c4b-989c-e4a0eac20447 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:46.370199 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42f2a94b-8f57-4c4b-989c-e4a0eac20447 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:46.370790 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42f2a94b-8f57-4c4b-989c-e4a0eac20447 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:46.371344 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42f2a94b-8f57-4c4b-989c-e4a0eac20447 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:46.510993 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-42f2a94b-8f57-4c4b-989c-e4a0eac20447 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:46.519244 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-42f2a94b-8f57-4c4b-989c-e4a0eac20447 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77" status: 200 len: 1674 microversion: 2.1 time: 0.166926 Sep 06 21:24:46.519854 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 557/1120] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:46 2022] GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77 => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:47.545520 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1a35e09c-2ad4-4232-8890-9230dbb33759 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:47.546098 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1a35e09c-2ad4-4232-8890-9230dbb33759 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:47.552453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a35e09c-2ad4-4232-8890-9230dbb33759 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:47.552979 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a35e09c-2ad4-4232-8890-9230dbb33759 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:47.553411 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a35e09c-2ad4-4232-8890-9230dbb33759 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:47.554090 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a35e09c-2ad4-4232-8890-9230dbb33759 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:47.554541 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a35e09c-2ad4-4232-8890-9230dbb33759 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:47.554964 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a35e09c-2ad4-4232-8890-9230dbb33759 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:47.628828 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1a35e09c-2ad4-4232-8890-9230dbb33759 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64033668b9fd4ba48eef09bdc3fdf2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcd82424984a0ba003e5324b505e54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:24:47.638760 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1a35e09c-2ad4-4232-8890-9230dbb33759 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77" status: 200 len: 1607 microversion: 2.1 time: 0.098644 Sep 06 21:24:47.639351 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 564/1121] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:47 2022] GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77 => generated 1607 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:24:48.252171 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-43f21e07-3a44-4ec0-bb1d-287cba32b82d req-fa74fc30-bc83-469d-a15d-b0deb50610d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c8fa97e-9971-4d57-8284-386f235d2a77", "name": "network-vif-deleted", "tag": "6332044f-f818-4635-8a4a-75463270aecd"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:24:48.263844 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-43f21e07-3a44-4ec0-bb1d-287cba32b82d req-fa74fc30-bc83-469d-a15d-b0deb50610d0 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:48.264307 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-43f21e07-3a44-4ec0-bb1d-287cba32b82d req-fa74fc30-bc83-469d-a15d-b0deb50610d0 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:48.264760 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-43f21e07-3a44-4ec0-bb1d-287cba32b82d req-fa74fc30-bc83-469d-a15d-b0deb50610d0 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:48.278795 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-43f21e07-3a44-4ec0-bb1d-287cba32b82d req-fa74fc30-bc83-469d-a15d-b0deb50610d0 service nova] Creating event network-vif-deleted:6332044f-f818-4635-8a4a-75463270aecd for instance 7c8fa97e-9971-4d57-8284-386f235d2a77 on hv-cinder-74915 Sep 06 21:24:48.285969 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-43f21e07-3a44-4ec0-bb1d-287cba32b82d req-fa74fc30-bc83-469d-a15d-b0deb50610d0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037648 Sep 06 21:24:48.290560 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 558/1122] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:24:48.666043 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5d4ea0db-7fd0-4e59-b771-4fa26c16a44c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:48.666769 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5d4ea0db-7fd0-4e59-b771-4fa26c16a44c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:48.677202 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d4ea0db-7fd0-4e59-b771-4fa26c16a44c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:48.678705 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d4ea0db-7fd0-4e59-b771-4fa26c16a44c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:48.680836 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d4ea0db-7fd0-4e59-b771-4fa26c16a44c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:48.680836 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d4ea0db-7fd0-4e59-b771-4fa26c16a44c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:48.680836 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d4ea0db-7fd0-4e59-b771-4fa26c16a44c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:48.680836 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d4ea0db-7fd0-4e59-b771-4fa26c16a44c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:48.697426 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-5d4ea0db-7fd0-4e59-b771-4fa26c16a44c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] HTTP exception thrown: Instance 7c8fa97e-9971-4d57-8284-386f235d2a77 could not be found. Sep 06 21:24:48.699128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5d4ea0db-7fd0-4e59-b771-4fa26c16a44c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Request method failure captured: Sep 06 21:24:48.699128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77 HTTP/1.1 Sep 06 21:24:48.699128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:24:48.699128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:24:48.699128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:24:48.699128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:24:48.699128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:24:48.699128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:24:48.699128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:24:48.699128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:24:48.699128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7gTafI_ZNMS2FAUEWoF-hkQ1NQ4-6kC6In2Ck9OdfqZOtnvrvDD7dhGsmk2W3QbGfvfNZVU6qZoYrUJYpieQuq-m8E365J674SZI20-lpkR-mroCGcvWzA22TXD35YMK7_HcTbWB9CZ8e2l2_bjTrnJcxjq1n27NciSiCZArYWGf6g Sep 06 21:24:48.699128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:24:48.699128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:24:48.699128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:24:48.699128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:24:48.699128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:24:48.699128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:24:48.699128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: cabcd82424984a0ba003e5324b505e54 Sep 06 21:24:48.699128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeTestJSON-2036003716 Sep 06 21:24:48.699128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:24:48.699128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:24:48.702933 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cabcd82424984a0ba003e5324b505e54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cabcd82424984a0ba003e5324b505e54", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cabcd82424984a0ba003e5324b505e54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cabcd82424984a0ba003e5324b505e54"}]}] Sep 06 21:24:48.702933 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeTestJSON-2036003716 Sep 06 21:24:48.702933 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: cabcd82424984a0ba003e5324b505e54 Sep 06 21:24:48.702933 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2036003716 Sep 06 21:24:48.702933 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeTestJSON-2036003716-project Sep 06 21:24:48.702933 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:24:48.702933 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:24:48.702933 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: 64033668b9fd4ba48eef09bdc3fdf2ee Sep 06 21:24:48.702933 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeTestJSON-2036003716-project Sep 06 21:24:48.702933 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: > Sep 06 21:24:48.702933 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Instance 7c8fa97e-9971-4d57-8284-386f235d2a77 could not be found. Sep 06 21:24:48.702933 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'id': '7c8fa97e-9971-4d57-8284-386f235d2a77'} Sep 06 21:24:48.703972 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:24:48.703972 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:24:48.703972 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:24:48.703972 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:24:48.703972 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:24:48.703972 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:24:48.703972 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:24:48.703972 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:24:48.703972 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:24:48.703972 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:24:48.703972 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c8fa97e-9971-4d57-8284-386f235d2a77 could not be found. Sep 06 21:24:48.703972 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:24:48.703972 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:24:48.703972 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:24:48.703972 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:24:48.703972 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:24:48.703972 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:24:48.703972 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:24:48.703972 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:24:48.703972 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:24:48.705836 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:24:48.705836 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:24:48.705836 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:24:48.705836 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:24:48.705836 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:24:48.705836 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:24:48.705836 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:24:48.705836 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c8fa97e-9971-4d57-8284-386f235d2a77 could not be found. Sep 06 21:24:48.705836 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:24:48.705836 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:24:48.705836 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:24:48.705836 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:24:48.705836 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:24:48.705836 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:24:48.705836 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:24:48.705836 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:24:48.705836 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c8fa97e-9971-4d57-8284-386f235d2a77 could not be found. Sep 06 21:24:48.705836 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:24:48.707321 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5d4ea0db-7fd0-4e59-b771-4fa26c16a44c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Returning 404 to user: Instance 7c8fa97e-9971-4d57-8284-386f235d2a77 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:24:48.707321 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5d4ea0db-7fd0-4e59-b771-4fa26c16a44c tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77" status: 404 len: 111 microversion: 2.1 time: 0.041515 Sep 06 21:24:48.707321 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 565/1123] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:48 2022] GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:24:48.710409 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9ac80d71-3adc-4662-b1ad-a3bdfb5c80c0 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '.version_select at 0x7f04ce415b80>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:48.733230 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9ac80d71-3adc-4662-b1ad-a3bdfb5c80c0 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1720488113" status: 202 len: 0 microversion: 2.1 time: 0.026854 Sep 06 21:24:48.736429 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 559/1124] 10.222.0.79 () {58 vars in 1221 bytes} [Tue Sep 6 21:24:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1720488113 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:24:51.699587 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a5bf0eea-1ca5-4db2-b1cb-e1832934d955 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:51.700128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a5bf0eea-1ca5-4db2-b1cb-e1832934d955 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:51.707255 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5bf0eea-1ca5-4db2-b1cb-e1832934d955 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:51.707731 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5bf0eea-1ca5-4db2-b1cb-e1832934d955 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:51.708165 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5bf0eea-1ca5-4db2-b1cb-e1832934d955 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:51.708908 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5bf0eea-1ca5-4db2-b1cb-e1832934d955 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:51.709995 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5bf0eea-1ca5-4db2-b1cb-e1832934d955 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:51.709995 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5bf0eea-1ca5-4db2-b1cb-e1832934d955 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:51.724696 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-a5bf0eea-1ca5-4db2-b1cb-e1832934d955 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] HTTP exception thrown: Instance 7c8fa97e-9971-4d57-8284-386f235d2a77 could not be found. Sep 06 21:24:51.726270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a5bf0eea-1ca5-4db2-b1cb-e1832934d955 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Request method failure captured: Sep 06 21:24:51.726270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77 HTTP/1.1 Sep 06 21:24:51.726270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:24:51.726270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:24:51.726270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:24:51.726270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:24:51.726270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:24:51.726270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:24:51.726270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:24:51.726270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:24:51.726270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7gTafI_ZNMS2FAUEWoF-hkQ1NQ4-6kC6In2Ck9OdfqZOtnvrvDD7dhGsmk2W3QbGfvfNZVU6qZoYrUJYpieQuq-m8E365J674SZI20-lpkR-mroCGcvWzA22TXD35YMK7_HcTbWB9CZ8e2l2_bjTrnJcxjq1n27NciSiCZArYWGf6g Sep 06 21:24:51.726270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:24:51.726270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:24:51.726270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:24:51.726270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:24:51.726270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:24:51.726270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:24:51.726270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: cabcd82424984a0ba003e5324b505e54 Sep 06 21:24:51.726270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeTestJSON-2036003716 Sep 06 21:24:51.726270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:24:51.726270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:24:51.727727 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cabcd82424984a0ba003e5324b505e54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cabcd82424984a0ba003e5324b505e54", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cabcd82424984a0ba003e5324b505e54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cabcd82424984a0ba003e5324b505e54"}]}] Sep 06 21:24:51.727727 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeTestJSON-2036003716 Sep 06 21:24:51.727727 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: cabcd82424984a0ba003e5324b505e54 Sep 06 21:24:51.727727 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2036003716 Sep 06 21:24:51.727727 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeTestJSON-2036003716-project Sep 06 21:24:51.727727 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:24:51.727727 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:24:51.727727 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: 64033668b9fd4ba48eef09bdc3fdf2ee Sep 06 21:24:51.727727 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeTestJSON-2036003716-project Sep 06 21:24:51.727727 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: > Sep 06 21:24:51.727727 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Instance 7c8fa97e-9971-4d57-8284-386f235d2a77 could not be found. Sep 06 21:24:51.727727 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'id': '7c8fa97e-9971-4d57-8284-386f235d2a77'} Sep 06 21:24:51.728446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:24:51.728446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:24:51.728446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:24:51.728446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:24:51.728446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:24:51.728446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:24:51.728446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:24:51.728446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:24:51.728446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:24:51.728446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:24:51.728446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c8fa97e-9971-4d57-8284-386f235d2a77 could not be found. Sep 06 21:24:51.728446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:24:51.728446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:24:51.728446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:24:51.728446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:24:51.728446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:24:51.728446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:24:51.728446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:24:51.728446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:24:51.728446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:24:51.729681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:24:51.729681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 21:24:51.729681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 21:24:51.729681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 21:24:51.729681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 21:24:51.729681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:24:51.729681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:24:51.729681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:24:51.729681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:24:51.729681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c8fa97e-9971-4d57-8284-386f235d2a77 could not be found. Sep 06 21:24:51.729681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:24:51.729681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:24:51.729681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:24:51.729681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:24:51.729681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:24:51.729681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:24:51.729681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:24:51.729681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:24:51.729681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c8fa97e-9971-4d57-8284-386f235d2a77 could not be found. Sep 06 21:24:51.729681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:24:51.730877 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a5bf0eea-1ca5-4db2-b1cb-e1832934d955 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Returning 404 to user: Instance 7c8fa97e-9971-4d57-8284-386f235d2a77 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:24:51.730877 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a5bf0eea-1ca5-4db2-b1cb-e1832934d955 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77" status: 404 len: 111 microversion: 2.1 time: 0.032028 Sep 06 21:24:51.730877 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 566/1125] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Sep 6 21:24:51 2022] DELETE /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:24:51.736519 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0fa3c065-9e8a-4aae-897c-1ad8d0610530 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:51.737335 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0fa3c065-9e8a-4aae-897c-1ad8d0610530 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 7c8fa97e-9971-4d57-8284-386f235d2a77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:51.746397 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0fa3c065-9e8a-4aae-897c-1ad8d0610530 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:51.746880 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0fa3c065-9e8a-4aae-897c-1ad8d0610530 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:51.747316 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0fa3c065-9e8a-4aae-897c-1ad8d0610530 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:51.748133 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0fa3c065-9e8a-4aae-897c-1ad8d0610530 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:51.748585 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0fa3c065-9e8a-4aae-897c-1ad8d0610530 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:51.749066 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0fa3c065-9e8a-4aae-897c-1ad8d0610530 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:51.763111 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-0fa3c065-9e8a-4aae-897c-1ad8d0610530 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] HTTP exception thrown: Instance 7c8fa97e-9971-4d57-8284-386f235d2a77 could not be found. Sep 06 21:24:51.764847 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0fa3c065-9e8a-4aae-897c-1ad8d0610530 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Request method failure captured: Sep 06 21:24:51.764847 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77 HTTP/1.1 Sep 06 21:24:51.764847 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 06 21:24:51.764847 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 06 21:24:51.764847 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Connection: close Sep 06 21:24:51.764847 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 06 21:24:51.764847 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 06 21:24:51.764847 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Host: 10.222.0.79 Sep 06 21:24:51.764847 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 06 21:24:51.764847 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 06 21:24:51.764847 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjF7gTafI_ZNMS2FAUEWoF-hkQ1NQ4-6kC6In2Ck9OdfqZOtnvrvDD7dhGsmk2W3QbGfvfNZVU6qZoYrUJYpieQuq-m8E365J674SZI20-lpkR-mroCGcvWzA22TXD35YMK7_HcTbWB9CZ8e2l2_bjTrnJcxjq1n27NciSiCZArYWGf6g Sep 06 21:24:51.764847 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 06 21:24:51.764847 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 06 21:24:51.764847 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 06 21:24:51.764847 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 06 21:24:51.764847 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 06 21:24:51.764847 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 06 21:24:51.764847 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Id: cabcd82424984a0ba003e5324b505e54 Sep 06 21:24:51.764847 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeTestJSON-2036003716 Sep 06 21:24:51.764847 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Role: reader,member Sep 06 21:24:51.764847 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Sep 06 21:24:51.766337 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cabcd82424984a0ba003e5324b505e54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cabcd82424984a0ba003e5324b505e54", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cabcd82424984a0ba003e5324b505e54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cabcd82424984a0ba003e5324b505e54"}]}] Sep 06 21:24:51.766337 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeTestJSON-2036003716 Sep 06 21:24:51.766337 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Id: cabcd82424984a0ba003e5324b505e54 Sep 06 21:24:51.766337 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2036003716 Sep 06 21:24:51.766337 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeTestJSON-2036003716-project Sep 06 21:24:51.766337 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 06 21:24:51.766337 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 06 21:24:51.766337 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Id: 64033668b9fd4ba48eef09bdc3fdf2ee Sep 06 21:24:51.766337 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeTestJSON-2036003716-project Sep 06 21:24:51.766337 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: method: > Sep 06 21:24:51.766337 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: exception: Instance 7c8fa97e-9971-4d57-8284-386f235d2a77 could not be found. Sep 06 21:24:51.766337 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: action_args: {'id': '7c8fa97e-9971-4d57-8284-386f235d2a77'} Sep 06 21:24:51.767181 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:24:51.767181 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:24:51.767181 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:24:51.767181 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:24:51.767181 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:24:51.767181 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:24:51.767181 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:24:51.767181 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:24:51.767181 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:24:51.767181 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:24:51.767181 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c8fa97e-9971-4d57-8284-386f235d2a77 could not be found. Sep 06 21:24:51.767181 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:24:51.767181 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:24:51.767181 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:24:51.767181 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:24:51.767181 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:24:51.767181 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:24:51.767181 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:24:51.767181 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:24:51.767181 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:24:51.769016 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:24:51.769016 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:24:51.769016 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:24:51.769016 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:24:51.769016 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:24:51.769016 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:24:51.769016 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:24:51.769016 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c8fa97e-9971-4d57-8284-386f235d2a77 could not be found. Sep 06 21:24:51.769016 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:24:51.769016 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:24:51.769016 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:24:51.769016 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:24:51.769016 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:24:51.769016 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:24:51.769016 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:24:51.769016 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:24:51.769016 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c8fa97e-9971-4d57-8284-386f235d2a77 could not be found. Sep 06 21:24:51.769016 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:24:51.770688 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0fa3c065-9e8a-4aae-897c-1ad8d0610530 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Returning 404 to user: Instance 7c8fa97e-9971-4d57-8284-386f235d2a77 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:24:51.770688 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0fa3c065-9e8a-4aae-897c-1ad8d0610530 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77" status: 404 len: 111 microversion: 2.1 time: 0.033730 Sep 06 21:24:51.770688 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 560/1126] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:51 2022] GET /compute/v2.1/servers/7c8fa97e-9971-4d57-8284-386f235d2a77 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:24:52.915193 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6ae0d1e1-d68a-4fb4-83cf-d52ee1c3ec84 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:52.915783 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6ae0d1e1-d68a-4fb4-83cf-d52ee1c3ec84 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:52.922372 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ae0d1e1-d68a-4fb4-83cf-d52ee1c3ec84 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:52.922853 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ae0d1e1-d68a-4fb4-83cf-d52ee1c3ec84 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:52.923288 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ae0d1e1-d68a-4fb4-83cf-d52ee1c3ec84 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:52.923994 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ae0d1e1-d68a-4fb4-83cf-d52ee1c3ec84 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:52.924448 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ae0d1e1-d68a-4fb4-83cf-d52ee1c3ec84 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:52.924913 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6ae0d1e1-d68a-4fb4-83cf-d52ee1c3ec84 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:52.938610 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-6ae0d1e1-d68a-4fb4-83cf-d52ee1c3ec84 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] HTTP exception thrown: Instance 9c787b30-603f-4b67-b10c-519b49f5e43f could not be found. Sep 06 21:24:52.940162 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6ae0d1e1-d68a-4fb4-83cf-d52ee1c3ec84 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Request method failure captured: Sep 06 21:24:52.940162 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f HTTP/1.1 Sep 06 21:24:52.940162 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:24:52.940162 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:24:52.940162 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:24:52.940162 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:24:52.940162 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:24:52.940162 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:24:52.940162 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:24:52.940162 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:24:52.940162 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7gTafI_ZNMS2FAUEWoF-hkQ1NQ4-6kC6In2Ck9OdfqZOtnvrvDD7dhGsmk2W3QbGfvfNZVU6qZoYrUJYpieQuq-m8E365J674SZI20-lpkR-mroCGcvWzA22TXD35YMK7_HcTbWB9CZ8e2l2_bjTrnJcxjq1n27NciSiCZArYWGf6g Sep 06 21:24:52.940162 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:24:52.940162 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:24:52.940162 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:24:52.940162 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:24:52.940162 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:24:52.940162 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:24:52.940162 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: cabcd82424984a0ba003e5324b505e54 Sep 06 21:24:52.940162 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeTestJSON-2036003716 Sep 06 21:24:52.940162 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:24:52.940162 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:24:52.941758 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cabcd82424984a0ba003e5324b505e54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cabcd82424984a0ba003e5324b505e54", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cabcd82424984a0ba003e5324b505e54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cabcd82424984a0ba003e5324b505e54"}]}] Sep 06 21:24:52.941758 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeTestJSON-2036003716 Sep 06 21:24:52.941758 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: cabcd82424984a0ba003e5324b505e54 Sep 06 21:24:52.941758 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2036003716 Sep 06 21:24:52.941758 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeTestJSON-2036003716-project Sep 06 21:24:52.941758 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:24:52.941758 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:24:52.941758 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: 64033668b9fd4ba48eef09bdc3fdf2ee Sep 06 21:24:52.941758 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeTestJSON-2036003716-project Sep 06 21:24:52.941758 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: > Sep 06 21:24:52.941758 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Instance 9c787b30-603f-4b67-b10c-519b49f5e43f could not be found. Sep 06 21:24:52.941758 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'id': '9c787b30-603f-4b67-b10c-519b49f5e43f'} Sep 06 21:24:52.942702 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:24:52.942702 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:24:52.942702 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:24:52.942702 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:24:52.942702 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:24:52.942702 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:24:52.942702 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:24:52.942702 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:24:52.942702 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:24:52.942702 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:24:52.942702 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c787b30-603f-4b67-b10c-519b49f5e43f could not be found. Sep 06 21:24:52.942702 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:24:52.942702 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:24:52.942702 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:24:52.942702 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:24:52.942702 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:24:52.942702 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:24:52.942702 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:24:52.942702 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:24:52.942702 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:24:52.944250 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:24:52.944250 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 21:24:52.944250 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 21:24:52.944250 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 21:24:52.944250 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 21:24:52.944250 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:24:52.944250 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:24:52.944250 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:24:52.944250 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:24:52.944250 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c787b30-603f-4b67-b10c-519b49f5e43f could not be found. Sep 06 21:24:52.944250 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:24:52.944250 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:24:52.944250 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:24:52.944250 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:24:52.944250 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:24:52.944250 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:24:52.944250 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:24:52.944250 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:24:52.944250 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c787b30-603f-4b67-b10c-519b49f5e43f could not be found. Sep 06 21:24:52.944250 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:24:52.945707 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6ae0d1e1-d68a-4fb4-83cf-d52ee1c3ec84 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Returning 404 to user: Instance 9c787b30-603f-4b67-b10c-519b49f5e43f could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:24:52.945707 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6ae0d1e1-d68a-4fb4-83cf-d52ee1c3ec84 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 404 len: 111 microversion: 2.1 time: 0.030953 Sep 06 21:24:52.945707 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 567/1127] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Sep 6 21:24:52 2022] DELETE /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:24:52.950623 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-12ca5bae-ab44-4e55-8b82-63df09dfc217 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:24:52.951223 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-12ca5bae-ab44-4e55-8b82-63df09dfc217 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] [instance: 9c787b30-603f-4b67-b10c-519b49f5e43f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:24:52.958106 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12ca5bae-ab44-4e55-8b82-63df09dfc217 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:52.958570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12ca5bae-ab44-4e55-8b82-63df09dfc217 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:52.958990 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12ca5bae-ab44-4e55-8b82-63df09dfc217 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:52.959669 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12ca5bae-ab44-4e55-8b82-63df09dfc217 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:24:52.960109 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12ca5bae-ab44-4e55-8b82-63df09dfc217 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:24:52.960516 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12ca5bae-ab44-4e55-8b82-63df09dfc217 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:24:52.975803 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-12ca5bae-ab44-4e55-8b82-63df09dfc217 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] HTTP exception thrown: Instance 9c787b30-603f-4b67-b10c-519b49f5e43f could not be found. Sep 06 21:24:52.977352 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-12ca5bae-ab44-4e55-8b82-63df09dfc217 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Request method failure captured: Sep 06 21:24:52.977352 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f HTTP/1.1 Sep 06 21:24:52.977352 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 06 21:24:52.977352 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 06 21:24:52.977352 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Connection: close Sep 06 21:24:52.977352 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 06 21:24:52.977352 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 06 21:24:52.977352 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Host: 10.222.0.79 Sep 06 21:24:52.977352 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 06 21:24:52.977352 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 06 21:24:52.977352 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjF7gTafI_ZNMS2FAUEWoF-hkQ1NQ4-6kC6In2Ck9OdfqZOtnvrvDD7dhGsmk2W3QbGfvfNZVU6qZoYrUJYpieQuq-m8E365J674SZI20-lpkR-mroCGcvWzA22TXD35YMK7_HcTbWB9CZ8e2l2_bjTrnJcxjq1n27NciSiCZArYWGf6g Sep 06 21:24:52.977352 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 06 21:24:52.977352 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 06 21:24:52.977352 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 06 21:24:52.977352 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 06 21:24:52.977352 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 06 21:24:52.977352 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 06 21:24:52.977352 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Id: cabcd82424984a0ba003e5324b505e54 Sep 06 21:24:52.977352 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeTestJSON-2036003716 Sep 06 21:24:52.977352 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Role: reader,member Sep 06 21:24:52.977352 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Sep 06 21:24:52.979014 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cabcd82424984a0ba003e5324b505e54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cabcd82424984a0ba003e5324b505e54", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cabcd82424984a0ba003e5324b505e54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cabcd82424984a0ba003e5324b505e54"}]}] Sep 06 21:24:52.979014 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeTestJSON-2036003716 Sep 06 21:24:52.979014 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Id: cabcd82424984a0ba003e5324b505e54 Sep 06 21:24:52.979014 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2036003716 Sep 06 21:24:52.979014 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeTestJSON-2036003716-project Sep 06 21:24:52.979014 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 06 21:24:52.979014 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 06 21:24:52.979014 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Id: 64033668b9fd4ba48eef09bdc3fdf2ee Sep 06 21:24:52.979014 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeTestJSON-2036003716-project Sep 06 21:24:52.979014 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: method: > Sep 06 21:24:52.979014 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: exception: Instance 9c787b30-603f-4b67-b10c-519b49f5e43f could not be found. Sep 06 21:24:52.979014 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: action_args: {'id': '9c787b30-603f-4b67-b10c-519b49f5e43f'} Sep 06 21:24:52.979860 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:24:52.979860 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:24:52.979860 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:24:52.979860 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:24:52.979860 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:24:52.979860 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:24:52.979860 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:24:52.979860 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:24:52.979860 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:24:52.979860 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:24:52.979860 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c787b30-603f-4b67-b10c-519b49f5e43f could not be found. Sep 06 21:24:52.979860 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:24:52.979860 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:24:52.979860 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:24:52.979860 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:24:52.979860 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:24:52.979860 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:24:52.979860 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:24:52.979860 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:24:52.979860 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:24:52.981174 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:24:52.981174 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:24:52.981174 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:24:52.981174 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:24:52.981174 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:24:52.981174 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:24:52.981174 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:24:52.981174 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c787b30-603f-4b67-b10c-519b49f5e43f could not be found. Sep 06 21:24:52.981174 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:24:52.981174 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:24:52.981174 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:24:52.981174 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:24:52.981174 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:24:52.981174 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:24:52.981174 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:24:52.981174 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:24:52.981174 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c787b30-603f-4b67-b10c-519b49f5e43f could not be found. Sep 06 21:24:52.981174 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:24:52.982490 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-12ca5bae-ab44-4e55-8b82-63df09dfc217 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] Returning 404 to user: Instance 9c787b30-603f-4b67-b10c-519b49f5e43f could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:24:52.982490 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-12ca5bae-ab44-4e55-8b82-63df09dfc217 tempest-AttachVolumeTestJSON-2036003716 tempest-AttachVolumeTestJSON-2036003716-project] 10.222.0.79 "GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f" status: 404 len: 111 microversion: 2.1 time: 0.032099 Sep 06 21:24:52.982490 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 561/1128] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:24:52 2022] GET /compute/v2.1/servers/9c787b30-603f-4b67-b10c-519b49f5e43f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:25:32.538469 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:25:32.539212 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=64,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:25:32.543811 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6213cc99-316a-44d4-8fbf-ba0a90d58250 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:25:32.546250 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6213cc99-316a-44d4-8fbf-ba0a90d58250 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:25:32.554282 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6213cc99-316a-44d4-8fbf-ba0a90d58250 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:32.554757 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6213cc99-316a-44d4-8fbf-ba0a90d58250 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:32.555190 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6213cc99-316a-44d4-8fbf-ba0a90d58250 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:32.555898 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6213cc99-316a-44d4-8fbf-ba0a90d58250 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:32.556344 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6213cc99-316a-44d4-8fbf-ba0a90d58250 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:32.556801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6213cc99-316a-44d4-8fbf-ba0a90d58250 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:32.590246 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6213cc99-316a-44d4-8fbf-ba0a90d58250 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053064 Sep 06 21:25:32.591102 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 568/1129] 10.222.0.79 () {60 vars in 1343 bytes} [Tue Sep 6 21:25:32 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:25:32.670800 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-111c67ac-0d0a-4f2a-adc7-15f8a3423ad0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:25:32.671364 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-111c67ac-0d0a-4f2a-adc7-15f8a3423ad0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:25:32.673464 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:25:32.674128 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:25:32.680033 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-111c67ac-0d0a-4f2a-adc7-15f8a3423ad0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:32.680548 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-111c67ac-0d0a-4f2a-adc7-15f8a3423ad0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:32.681098 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-111c67ac-0d0a-4f2a-adc7-15f8a3423ad0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:32.681887 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-111c67ac-0d0a-4f2a-adc7-15f8a3423ad0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:32.682388 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-111c67ac-0d0a-4f2a-adc7-15f8a3423ad0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:32.682872 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-111c67ac-0d0a-4f2a-adc7-15f8a3423ad0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:32.713936 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-111c67ac-0d0a-4f2a-adc7-15f8a3423ad0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 21:25:32.797600 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-111c67ac-0d0a-4f2a-adc7-15f8a3423ad0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 204 len: 0 microversion: 2.20 time: 0.133598 Sep 06 21:25:32.798324 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 562/1130] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Sep 6 21:25:32 2022] DELETE /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 21:25:32.807140 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-354c1ab0-2701-47df-9b4c-a0e611f0d597 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:25:32.808005 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-354c1ab0-2701-47df-9b4c-a0e611f0d597 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:25:32.814037 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-354c1ab0-2701-47df-9b4c-a0e611f0d597 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:32.814532 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-354c1ab0-2701-47df-9b4c-a0e611f0d597 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:32.814966 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-354c1ab0-2701-47df-9b4c-a0e611f0d597 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:32.815705 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-354c1ab0-2701-47df-9b4c-a0e611f0d597 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:32.816160 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-354c1ab0-2701-47df-9b4c-a0e611f0d597 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:32.816586 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-354c1ab0-2701-47df-9b4c-a0e611f0d597 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:32.958053 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-354c1ab0-2701-47df-9b4c-a0e611f0d597 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:25:32.966838 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-354c1ab0-2701-47df-9b4c-a0e611f0d597 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:25:32.968686 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-354c1ab0-2701-47df-9b4c-a0e611f0d597 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:25:32.969912 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-354c1ab0-2701-47df-9b4c-a0e611f0d597 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1724 microversion: 2.20 time: 0.166941 Sep 06 21:25:32.970751 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 569/1131] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:25:32 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:25:34.000367 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-604d6132-2615-442b-bccc-d3d41534b8c0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:25:34.001100 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-604d6132-2615-442b-bccc-d3d41534b8c0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:25:34.008204 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-604d6132-2615-442b-bccc-d3d41534b8c0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:34.008755 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-604d6132-2615-442b-bccc-d3d41534b8c0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:34.009193 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-604d6132-2615-442b-bccc-d3d41534b8c0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:34.010204 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-604d6132-2615-442b-bccc-d3d41534b8c0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:34.010330 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-604d6132-2615-442b-bccc-d3d41534b8c0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:34.010754 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-604d6132-2615-442b-bccc-d3d41534b8c0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:34.152386 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-604d6132-2615-442b-bccc-d3d41534b8c0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:25:34.161445 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-604d6132-2615-442b-bccc-d3d41534b8c0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:25:34.162867 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-604d6132-2615-442b-bccc-d3d41534b8c0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:25:34.164117 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-604d6132-2615-442b-bccc-d3d41534b8c0 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1724 microversion: 2.20 time: 0.168307 Sep 06 21:25:34.164857 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 563/1132] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:25:33 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:25:35.189490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2161fce8-af64-412e-a260-8b39a57a80ff tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:25:35.190110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2161fce8-af64-412e-a260-8b39a57a80ff tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:25:35.199648 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2161fce8-af64-412e-a260-8b39a57a80ff tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:35.200241 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2161fce8-af64-412e-a260-8b39a57a80ff tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:35.200702 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2161fce8-af64-412e-a260-8b39a57a80ff tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:35.201399 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2161fce8-af64-412e-a260-8b39a57a80ff tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:35.201852 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2161fce8-af64-412e-a260-8b39a57a80ff tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:35.202280 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2161fce8-af64-412e-a260-8b39a57a80ff tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:35.338894 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2161fce8-af64-412e-a260-8b39a57a80ff tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:25:35.347435 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2161fce8-af64-412e-a260-8b39a57a80ff tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:25:35.349166 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2161fce8-af64-412e-a260-8b39a57a80ff tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:25:35.350351 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2161fce8-af64-412e-a260-8b39a57a80ff tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1724 microversion: 2.20 time: 0.164981 Sep 06 21:25:35.350921 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 570/1133] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:25:35 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:25:35.781831 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-5dd4d0a8-fe08-408b-be5c-c32dfb08e5eb req-1cc068df-d5e4-41a8-a4f2-886c78279f61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8066f708-d355-454f-b0fd-7b33e51e265e", "name": "network-vif-deleted", "tag": "d805515a-5f19-4507-b89b-93b54084b935"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:25:35.794107 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5dd4d0a8-fe08-408b-be5c-c32dfb08e5eb req-1cc068df-d5e4-41a8-a4f2-886c78279f61 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:35.794586 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5dd4d0a8-fe08-408b-be5c-c32dfb08e5eb req-1cc068df-d5e4-41a8-a4f2-886c78279f61 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:35.795037 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5dd4d0a8-fe08-408b-be5c-c32dfb08e5eb req-1cc068df-d5e4-41a8-a4f2-886c78279f61 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:35.808104 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-5dd4d0a8-fe08-408b-be5c-c32dfb08e5eb req-1cc068df-d5e4-41a8-a4f2-886c78279f61 service nova] Creating event network-vif-deleted:d805515a-5f19-4507-b89b-93b54084b935 for instance 8066f708-d355-454f-b0fd-7b33e51e265e on hv-cinder-74915 Sep 06 21:25:35.814138 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-5dd4d0a8-fe08-408b-be5c-c32dfb08e5eb req-1cc068df-d5e4-41a8-a4f2-886c78279f61 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036928 Sep 06 21:25:35.814744 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 564/1134] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:25:36.376746 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a462f7f2-b17d-4d12-84e0-3d8ed17e04b2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:25:36.378013 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a462f7f2-b17d-4d12-84e0-3d8ed17e04b2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:25:36.386528 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a462f7f2-b17d-4d12-84e0-3d8ed17e04b2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:36.387016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a462f7f2-b17d-4d12-84e0-3d8ed17e04b2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:36.387452 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a462f7f2-b17d-4d12-84e0-3d8ed17e04b2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:36.388163 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a462f7f2-b17d-4d12-84e0-3d8ed17e04b2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:36.388697 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a462f7f2-b17d-4d12-84e0-3d8ed17e04b2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:36.389435 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a462f7f2-b17d-4d12-84e0-3d8ed17e04b2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:36.429549 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a462f7f2-b17d-4d12-84e0-3d8ed17e04b2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:36.430035 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a462f7f2-b17d-4d12-84e0-3d8ed17e04b2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:36.430475 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a462f7f2-b17d-4d12-84e0-3d8ed17e04b2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:36.430931 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-a462f7f2-b17d-4d12-84e0-3d8ed17e04b2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lazy-loading 'fault' on Instance uuid 8066f708-d355-454f-b0fd-7b33e51e265e {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:25:36.486033 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a462f7f2-b17d-4d12-84e0-3d8ed17e04b2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:25:36.495954 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a462f7f2-b17d-4d12-84e0-3d8ed17e04b2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:25:36.498348 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a462f7f2-b17d-4d12-84e0-3d8ed17e04b2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54fe3d99f05c45f099804fccb4679503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39683d687e424fbed4539cb4040060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:25:36.499583 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a462f7f2-b17d-4d12-84e0-3d8ed17e04b2 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 200 len: 1372 microversion: 2.20 time: 0.127657 Sep 06 21:25:36.500150 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 571/1135] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:25:36 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 1372 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 21:25:37.528827 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-23f1e881-1a67-49cd-9428-38f01355e0b4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:25:37.529521 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-23f1e881-1a67-49cd-9428-38f01355e0b4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:25:37.536160 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23f1e881-1a67-49cd-9428-38f01355e0b4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:37.536620 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23f1e881-1a67-49cd-9428-38f01355e0b4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:37.537258 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23f1e881-1a67-49cd-9428-38f01355e0b4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:37.537966 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23f1e881-1a67-49cd-9428-38f01355e0b4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:37.538600 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23f1e881-1a67-49cd-9428-38f01355e0b4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:37.539006 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23f1e881-1a67-49cd-9428-38f01355e0b4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:37.554070 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-23f1e881-1a67-49cd-9428-38f01355e0b4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] HTTP exception thrown: Instance 8066f708-d355-454f-b0fd-7b33e51e265e could not be found. Sep 06 21:25:37.555899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-23f1e881-1a67-49cd-9428-38f01355e0b4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Request method failure captured: Sep 06 21:25:37.555899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e HTTP/1.1 Sep 06 21:25:37.555899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 06 21:25:37.555899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 06 21:25:37.555899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Connection: close Sep 06 21:25:37.555899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 06 21:25:37.555899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 06 21:25:37.555899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Host: 10.222.0.79 Sep 06 21:25:37.555899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 06 21:25:37.555899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 06 21:25:37.555899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjF7gRf8alxX1BmUMrmHhnD4zgzkcOMnoxdEBr5jOU86p2grAFeVa1tmlfeQXBdImGrz2RjefC5ZtMwh6QscByuLVxfRsnmCE6LsmTrbODQVyQbaVxUIUMbxTgHeZ_dyD5-x-316bs8zp3WkSAWcjs6kP6cXtvTjd4pMGov7pahmoRW2w Sep 06 21:25:37.555899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 06 21:25:37.555899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 06 21:25:37.555899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 06 21:25:37.555899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 06 21:25:37.555899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 21:25:37.555899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 06 21:25:37.555899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 06 21:25:37.555899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Id: 2e39683d687e424fbed4539cb4040060 Sep 06 21:25:37.555899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-66209968 Sep 06 21:25:37.555899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Role: reader,member Sep 06 21:25:37.555899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Sep 06 21:25:37.557709 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2e39683d687e424fbed4539cb4040060"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2e39683d687e424fbed4539cb4040060", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2e39683d687e424fbed4539cb4040060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2e39683d687e424fbed4539cb4040060"}]}] Sep 06 21:25:37.557709 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeShelveTestJSON-66209968 Sep 06 21:25:37.557709 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 2e39683d687e424fbed4539cb4040060 Sep 06 21:25:37.557709 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-66209968 Sep 06 21:25:37.557709 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeShelveTestJSON-66209968-project Sep 06 21:25:37.557709 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 06 21:25:37.557709 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 06 21:25:37.557709 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Id: 54fe3d99f05c45f099804fccb4679503 Sep 06 21:25:37.557709 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeShelveTestJSON-66209968-project Sep 06 21:25:37.557709 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: method: > Sep 06 21:25:37.557709 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: exception: Instance 8066f708-d355-454f-b0fd-7b33e51e265e could not be found. Sep 06 21:25:37.557709 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: action_args: {'id': '8066f708-d355-454f-b0fd-7b33e51e265e'} Sep 06 21:25:37.558710 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:25:37.558710 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:25:37.558710 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:25:37.558710 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:25:37.558710 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:25:37.558710 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:25:37.558710 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:25:37.558710 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:25:37.558710 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:25:37.558710 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:25:37.558710 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8066f708-d355-454f-b0fd-7b33e51e265e could not be found. Sep 06 21:25:37.558710 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:25:37.558710 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:25:37.558710 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:25:37.558710 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:25:37.558710 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:25:37.558710 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:25:37.558710 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:25:37.558710 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:25:37.558710 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:25:37.560309 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:25:37.560309 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:25:37.560309 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:25:37.560309 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:25:37.560309 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:25:37.560309 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:25:37.560309 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:25:37.560309 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8066f708-d355-454f-b0fd-7b33e51e265e could not be found. Sep 06 21:25:37.560309 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:25:37.560309 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:25:37.560309 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:25:37.560309 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:25:37.560309 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:25:37.560309 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:25:37.560309 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:25:37.560309 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:25:37.560309 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8066f708-d355-454f-b0fd-7b33e51e265e could not be found. Sep 06 21:25:37.560309 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:25:37.561700 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-23f1e881-1a67-49cd-9428-38f01355e0b4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Returning 404 to user: Instance 8066f708-d355-454f-b0fd-7b33e51e265e could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:25:37.561700 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-23f1e881-1a67-49cd-9428-38f01355e0b4 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 404 len: 111 microversion: 2.20 time: 0.033400 Sep 06 21:25:37.561700 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 565/1136] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:25:37 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 21:25:37.566463 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-39628d8d-1be3-4f85-b4f0-2741790eca77 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '.version_select at 0x7f04ce6854c0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:25:37.587294 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-39628d8d-1be3-4f85-b4f0-2741790eca77 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2110135943" status: 204 len: 0 microversion: 2.20 time: 0.024719 Sep 06 21:25:37.588154 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 572/1137] 10.222.0.79 () {60 vars in 1262 bytes} [Tue Sep 6 21:25:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2110135943 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 21:25:39.626588 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4d5b0f2e-0a2f-4ba6-9a82-09567c858b78 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:25:39.627107 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4d5b0f2e-0a2f-4ba6-9a82-09567c858b78 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:25:39.633944 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d5b0f2e-0a2f-4ba6-9a82-09567c858b78 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:39.634418 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d5b0f2e-0a2f-4ba6-9a82-09567c858b78 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:39.634837 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d5b0f2e-0a2f-4ba6-9a82-09567c858b78 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:39.635530 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d5b0f2e-0a2f-4ba6-9a82-09567c858b78 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:39.635968 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d5b0f2e-0a2f-4ba6-9a82-09567c858b78 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:39.636379 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d5b0f2e-0a2f-4ba6-9a82-09567c858b78 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:39.650170 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-4d5b0f2e-0a2f-4ba6-9a82-09567c858b78 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] HTTP exception thrown: Instance 8066f708-d355-454f-b0fd-7b33e51e265e could not be found. Sep 06 21:25:39.651704 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4d5b0f2e-0a2f-4ba6-9a82-09567c858b78 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Request method failure captured: Sep 06 21:25:39.651704 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e HTTP/1.1 Sep 06 21:25:39.651704 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 06 21:25:39.651704 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 06 21:25:39.651704 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Connection: close Sep 06 21:25:39.651704 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 06 21:25:39.651704 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 06 21:25:39.651704 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Host: 10.222.0.79 Sep 06 21:25:39.651704 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 06 21:25:39.651704 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 06 21:25:39.651704 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjF7gRf8alxX1BmUMrmHhnD4zgzkcOMnoxdEBr5jOU86p2grAFeVa1tmlfeQXBdImGrz2RjefC5ZtMwh6QscByuLVxfRsnmCE6LsmTrbODQVyQbaVxUIUMbxTgHeZ_dyD5-x-316bs8zp3WkSAWcjs6kP6cXtvTjd4pMGov7pahmoRW2w Sep 06 21:25:39.651704 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 06 21:25:39.651704 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 06 21:25:39.651704 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 06 21:25:39.651704 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 06 21:25:39.651704 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 21:25:39.651704 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 06 21:25:39.651704 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 06 21:25:39.651704 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Id: 2e39683d687e424fbed4539cb4040060 Sep 06 21:25:39.651704 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-66209968 Sep 06 21:25:39.651704 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Role: reader,member Sep 06 21:25:39.651704 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Sep 06 21:25:39.653498 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2e39683d687e424fbed4539cb4040060"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2e39683d687e424fbed4539cb4040060", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2e39683d687e424fbed4539cb4040060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2e39683d687e424fbed4539cb4040060"}]}] Sep 06 21:25:39.653498 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeShelveTestJSON-66209968 Sep 06 21:25:39.653498 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 2e39683d687e424fbed4539cb4040060 Sep 06 21:25:39.653498 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-66209968 Sep 06 21:25:39.653498 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeShelveTestJSON-66209968-project Sep 06 21:25:39.653498 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 06 21:25:39.653498 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 06 21:25:39.653498 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Id: 54fe3d99f05c45f099804fccb4679503 Sep 06 21:25:39.653498 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeShelveTestJSON-66209968-project Sep 06 21:25:39.653498 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: method: > Sep 06 21:25:39.653498 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: exception: Instance 8066f708-d355-454f-b0fd-7b33e51e265e could not be found. Sep 06 21:25:39.653498 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: action_args: {'id': '8066f708-d355-454f-b0fd-7b33e51e265e'} Sep 06 21:25:39.654335 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:25:39.654335 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:25:39.654335 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:25:39.654335 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:25:39.654335 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:25:39.654335 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:25:39.654335 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:25:39.654335 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:25:39.654335 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:25:39.654335 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:25:39.654335 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8066f708-d355-454f-b0fd-7b33e51e265e could not be found. Sep 06 21:25:39.654335 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:25:39.654335 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:25:39.654335 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:25:39.654335 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:25:39.654335 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:25:39.654335 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:25:39.654335 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:25:39.654335 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:25:39.654335 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:25:39.655872 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:25:39.655872 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 21:25:39.655872 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 21:25:39.655872 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 21:25:39.655872 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 21:25:39.655872 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:25:39.655872 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:25:39.655872 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:25:39.655872 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:25:39.655872 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8066f708-d355-454f-b0fd-7b33e51e265e could not be found. Sep 06 21:25:39.655872 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:25:39.655872 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:25:39.655872 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:25:39.655872 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:25:39.655872 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:25:39.655872 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:25:39.655872 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:25:39.655872 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:25:39.655872 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8066f708-d355-454f-b0fd-7b33e51e265e could not be found. Sep 06 21:25:39.655872 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:25:39.657400 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4d5b0f2e-0a2f-4ba6-9a82-09567c858b78 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Returning 404 to user: Instance 8066f708-d355-454f-b0fd-7b33e51e265e could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:25:39.657400 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4d5b0f2e-0a2f-4ba6-9a82-09567c858b78 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 404 len: 111 microversion: 2.20 time: 0.030603 Sep 06 21:25:39.657400 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 566/1138] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Sep 6 21:25:39 2022] DELETE /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 21:25:39.663020 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b6af7b2f-694d-48a7-aecf-2eb95b7aced6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:25:39.663640 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b6af7b2f-694d-48a7-aecf-2eb95b7aced6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8066f708-d355-454f-b0fd-7b33e51e265e] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:25:39.671383 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6af7b2f-694d-48a7-aecf-2eb95b7aced6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:39.671862 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6af7b2f-694d-48a7-aecf-2eb95b7aced6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:39.672289 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6af7b2f-694d-48a7-aecf-2eb95b7aced6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:39.673011 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6af7b2f-694d-48a7-aecf-2eb95b7aced6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:39.673443 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6af7b2f-694d-48a7-aecf-2eb95b7aced6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:39.673870 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b6af7b2f-694d-48a7-aecf-2eb95b7aced6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:39.687521 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-b6af7b2f-694d-48a7-aecf-2eb95b7aced6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] HTTP exception thrown: Instance 8066f708-d355-454f-b0fd-7b33e51e265e could not be found. Sep 06 21:25:39.689161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b6af7b2f-694d-48a7-aecf-2eb95b7aced6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Request method failure captured: Sep 06 21:25:39.689161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e HTTP/1.1 Sep 06 21:25:39.689161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:25:39.689161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:25:39.689161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:25:39.689161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:25:39.689161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:25:39.689161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:25:39.689161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:25:39.689161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:25:39.689161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7gRf8alxX1BmUMrmHhnD4zgzkcOMnoxdEBr5jOU86p2grAFeVa1tmlfeQXBdImGrz2RjefC5ZtMwh6QscByuLVxfRsnmCE6LsmTrbODQVyQbaVxUIUMbxTgHeZ_dyD5-x-316bs8zp3WkSAWcjs6kP6cXtvTjd4pMGov7pahmoRW2w Sep 06 21:25:39.689161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:25:39.689161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:25:39.689161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:25:39.689161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:25:39.689161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 21:25:39.689161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:25:39.689161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:25:39.689161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: 2e39683d687e424fbed4539cb4040060 Sep 06 21:25:39.689161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-66209968 Sep 06 21:25:39.689161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:25:39.689161 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:25:39.690841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2e39683d687e424fbed4539cb4040060"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2e39683d687e424fbed4539cb4040060", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2e39683d687e424fbed4539cb4040060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2e39683d687e424fbed4539cb4040060"}]}] Sep 06 21:25:39.690841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeShelveTestJSON-66209968 Sep 06 21:25:39.690841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 2e39683d687e424fbed4539cb4040060 Sep 06 21:25:39.690841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-66209968 Sep 06 21:25:39.690841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeShelveTestJSON-66209968-project Sep 06 21:25:39.690841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:25:39.690841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:25:39.690841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: 54fe3d99f05c45f099804fccb4679503 Sep 06 21:25:39.690841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeShelveTestJSON-66209968-project Sep 06 21:25:39.690841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: > Sep 06 21:25:39.690841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Instance 8066f708-d355-454f-b0fd-7b33e51e265e could not be found. Sep 06 21:25:39.690841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'id': '8066f708-d355-454f-b0fd-7b33e51e265e'} Sep 06 21:25:39.691699 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:25:39.691699 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:25:39.691699 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:25:39.691699 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:25:39.691699 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:25:39.691699 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:25:39.691699 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:25:39.691699 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:25:39.691699 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:25:39.691699 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:25:39.691699 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8066f708-d355-454f-b0fd-7b33e51e265e could not be found. Sep 06 21:25:39.691699 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:25:39.691699 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:25:39.691699 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:25:39.691699 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:25:39.691699 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:25:39.691699 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:25:39.691699 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:25:39.691699 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:25:39.691699 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:25:39.693131 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:25:39.693131 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:25:39.693131 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:25:39.693131 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:25:39.693131 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:25:39.693131 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:25:39.693131 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:25:39.693131 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8066f708-d355-454f-b0fd-7b33e51e265e could not be found. Sep 06 21:25:39.693131 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:25:39.693131 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:25:39.693131 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:25:39.693131 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:25:39.693131 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:25:39.693131 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:25:39.693131 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:25:39.693131 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:25:39.693131 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8066f708-d355-454f-b0fd-7b33e51e265e could not be found. Sep 06 21:25:39.693131 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:25:39.694483 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b6af7b2f-694d-48a7-aecf-2eb95b7aced6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Returning 404 to user: Instance 8066f708-d355-454f-b0fd-7b33e51e265e could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:25:39.694483 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b6af7b2f-694d-48a7-aecf-2eb95b7aced6 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e" status: 404 len: 111 microversion: 2.20 time: 0.032053 Sep 06 21:25:39.694483 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 573/1139] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:25:39 2022] GET /compute/v2.1/servers/8066f708-d355-454f-b0fd-7b33e51e265e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 21:25:40.366810 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fa0d7281-960a-46f6-a779-66424acde01f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-938084939", "imageRef": "8b4a7612-517c-4711-8637-36b221338f65", "flavorRef": "452", "networks": [{"uuid": "ae9ccc66-7409-4d24-9a32-6f7c395b5589"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:25:40.423047 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-fa0d7281-960a-46f6-a779-66424acde01f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] validate_networks() for [('ae9ccc66-7409-4d24-9a32-6f7c395b5589', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 21:25:40.779577 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-fa0d7281-960a-46f6-a779-66424acde01f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 21:25:40.780221 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-fa0d7281-960a-46f6-a779-66424acde01f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 21:25:40.780447 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-fa0d7281-960a-46f6-a779-66424acde01f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 21:25:40.780886 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-fa0d7281-960a-46f6-a779-66424acde01f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 21:25:40.781300 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-fa0d7281-960a-46f6-a779-66424acde01f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 21:25:40.790772 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa0d7281-960a-46f6-a779-66424acde01f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:40.791183 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa0d7281-960a-46f6-a779-66424acde01f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:40.791622 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa0d7281-960a-46f6-a779-66424acde01f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:40.792347 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa0d7281-960a-46f6-a779-66424acde01f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:40.792836 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa0d7281-960a-46f6-a779-66424acde01f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:40.793648 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa0d7281-960a-46f6-a779-66424acde01f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:40.811063 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-fa0d7281-960a-46f6-a779-66424acde01f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Getting quotas for project 8c3a88bdee6e4566987b3e87b4627ca6. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:25:40.815336 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-fa0d7281-960a-46f6-a779-66424acde01f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Getting quotas for user 525ba710ef8b40d0abb27bb2cad1095c and project 8c3a88bdee6e4566987b3e87b4627ca6. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:25:40.827279 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fa0d7281-960a-46f6-a779-66424acde01f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 21:25:40.831021 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fa0d7281-960a-46f6-a779-66424acde01f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: ae214669-ef86-4fe1-aab8-2f83b53b96fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8b4a7612-517c-4711-8637-36b221338f65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 21:25:40.836262 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a8580f54-1b9c-4efc-9cab-f7136cd52e50 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:25:40.836752 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a8580f54-1b9c-4efc-9cab-f7136cd52e50 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:25:40.843829 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8580f54-1b9c-4efc-9cab-f7136cd52e50 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:40.844399 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8580f54-1b9c-4efc-9cab-f7136cd52e50 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:40.844859 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8580f54-1b9c-4efc-9cab-f7136cd52e50 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:40.845567 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8580f54-1b9c-4efc-9cab-f7136cd52e50 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:40.846025 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8580f54-1b9c-4efc-9cab-f7136cd52e50 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:40.846485 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8580f54-1b9c-4efc-9cab-f7136cd52e50 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:40.860482 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-a8580f54-1b9c-4efc-9cab-f7136cd52e50 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] HTTP exception thrown: Instance 8fea1aa0-032e-454d-9358-98a81cd5d650 could not be found. Sep 06 21:25:40.862218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a8580f54-1b9c-4efc-9cab-f7136cd52e50 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Request method failure captured: Sep 06 21:25:40.862218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 HTTP/1.1 Sep 06 21:25:40.862218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:25:40.862218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:25:40.862218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:25:40.862218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:25:40.862218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:25:40.862218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:25:40.862218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:25:40.862218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:25:40.862218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7gRf8alxX1BmUMrmHhnD4zgzkcOMnoxdEBr5jOU86p2grAFeVa1tmlfeQXBdImGrz2RjefC5ZtMwh6QscByuLVxfRsnmCE6LsmTrbODQVyQbaVxUIUMbxTgHeZ_dyD5-x-316bs8zp3WkSAWcjs6kP6cXtvTjd4pMGov7pahmoRW2w Sep 06 21:25:40.862218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:25:40.862218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:25:40.862218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:25:40.862218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:25:40.862218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 21:25:40.862218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:25:40.862218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:25:40.862218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: 2e39683d687e424fbed4539cb4040060 Sep 06 21:25:40.862218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-66209968 Sep 06 21:25:40.862218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:25:40.862218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:25:40.863982 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2e39683d687e424fbed4539cb4040060"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2e39683d687e424fbed4539cb4040060", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2e39683d687e424fbed4539cb4040060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2e39683d687e424fbed4539cb4040060"}]}] Sep 06 21:25:40.863982 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeShelveTestJSON-66209968 Sep 06 21:25:40.863982 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 2e39683d687e424fbed4539cb4040060 Sep 06 21:25:40.863982 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-66209968 Sep 06 21:25:40.863982 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeShelveTestJSON-66209968-project Sep 06 21:25:40.863982 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:25:40.863982 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:25:40.863982 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: 54fe3d99f05c45f099804fccb4679503 Sep 06 21:25:40.863982 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeShelveTestJSON-66209968-project Sep 06 21:25:40.863982 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: > Sep 06 21:25:40.863982 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Instance 8fea1aa0-032e-454d-9358-98a81cd5d650 could not be found. Sep 06 21:25:40.863982 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'id': '8fea1aa0-032e-454d-9358-98a81cd5d650'} Sep 06 21:25:40.865795 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:25:40.865795 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:25:40.865795 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:25:40.865795 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:25:40.865795 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:25:40.865795 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:25:40.865795 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:25:40.865795 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:25:40.865795 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:25:40.865795 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:25:40.865795 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fea1aa0-032e-454d-9358-98a81cd5d650 could not be found. Sep 06 21:25:40.865795 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:25:40.865795 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:25:40.865795 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:25:40.865795 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:25:40.865795 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:25:40.865795 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:25:40.865795 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:25:40.865795 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:25:40.865795 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:25:40.867791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:25:40.867791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 21:25:40.867791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 21:25:40.867791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 21:25:40.867791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 21:25:40.867791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:25:40.867791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:25:40.867791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:25:40.867791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:25:40.867791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fea1aa0-032e-454d-9358-98a81cd5d650 could not be found. Sep 06 21:25:40.867791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:25:40.867791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:25:40.867791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:25:40.867791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:25:40.867791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:25:40.867791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:25:40.867791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:25:40.867791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:25:40.867791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fea1aa0-032e-454d-9358-98a81cd5d650 could not be found. Sep 06 21:25:40.867791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:25:40.869460 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a8580f54-1b9c-4efc-9cab-f7136cd52e50 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Returning 404 to user: Instance 8fea1aa0-032e-454d-9358-98a81cd5d650 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:25:40.869460 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a8580f54-1b9c-4efc-9cab-f7136cd52e50 tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 404 len: 111 microversion: 2.20 time: 0.031478 Sep 06 21:25:40.869460 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 574/1140] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Sep 6 21:25:40 2022] DELETE /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 21:25:40.873985 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9d228342-a61b-4218-8331-2eba41f58b4f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:25:40.874609 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9d228342-a61b-4218-8331-2eba41f58b4f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] [instance: 8fea1aa0-032e-454d-9358-98a81cd5d650] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:25:40.877983 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fa0d7281-960a-46f6-a779-66424acde01f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.515857 Sep 06 21:25:40.881295 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d228342-a61b-4218-8331-2eba41f58b4f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:40.881779 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d228342-a61b-4218-8331-2eba41f58b4f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:40.882207 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d228342-a61b-4218-8331-2eba41f58b4f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:40.883108 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d228342-a61b-4218-8331-2eba41f58b4f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:40.883362 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d228342-a61b-4218-8331-2eba41f58b4f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:40.883789 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d228342-a61b-4218-8331-2eba41f58b4f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:40.884994 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 567/1141] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Sep 6 21:25:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 21:25:40.889975 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6e01b59a-794e-4bfe-9107-9d7076ca4b3d tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:25:40.890609 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6e01b59a-794e-4bfe-9107-9d7076ca4b3d tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: ae214669-ef86-4fe1-aab8-2f83b53b96fb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:25:40.899587 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-9d228342-a61b-4218-8331-2eba41f58b4f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] HTTP exception thrown: Instance 8fea1aa0-032e-454d-9358-98a81cd5d650 could not be found. Sep 06 21:25:40.901208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9d228342-a61b-4218-8331-2eba41f58b4f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Request method failure captured: Sep 06 21:25:40.901208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 HTTP/1.1 Sep 06 21:25:40.901208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:25:40.901208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:25:40.901208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:25:40.901208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:25:40.901208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:25:40.901208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:25:40.901208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:25:40.901208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:25:40.901208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7gRf8alxX1BmUMrmHhnD4zgzkcOMnoxdEBr5jOU86p2grAFeVa1tmlfeQXBdImGrz2RjefC5ZtMwh6QscByuLVxfRsnmCE6LsmTrbODQVyQbaVxUIUMbxTgHeZ_dyD5-x-316bs8zp3WkSAWcjs6kP6cXtvTjd4pMGov7pahmoRW2w Sep 06 21:25:40.901208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:25:40.901208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:25:40.901208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:25:40.901208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:25:40.901208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 21:25:40.901208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:25:40.901208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:25:40.901208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: 2e39683d687e424fbed4539cb4040060 Sep 06 21:25:40.901208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-66209968 Sep 06 21:25:40.901208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:25:40.901208 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:25:40.902691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2e39683d687e424fbed4539cb4040060"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2e39683d687e424fbed4539cb4040060", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2e39683d687e424fbed4539cb4040060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2e39683d687e424fbed4539cb4040060"}]}] Sep 06 21:25:40.902691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeShelveTestJSON-66209968 Sep 06 21:25:40.902691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 2e39683d687e424fbed4539cb4040060 Sep 06 21:25:40.902691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-66209968 Sep 06 21:25:40.902691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeShelveTestJSON-66209968-project Sep 06 21:25:40.902691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:25:40.902691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:25:40.902691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: 54fe3d99f05c45f099804fccb4679503 Sep 06 21:25:40.902691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeShelveTestJSON-66209968-project Sep 06 21:25:40.902691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: > Sep 06 21:25:40.902691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Instance 8fea1aa0-032e-454d-9358-98a81cd5d650 could not be found. Sep 06 21:25:40.902691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'id': '8fea1aa0-032e-454d-9358-98a81cd5d650'} Sep 06 21:25:40.903453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:25:40.903453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:25:40.903453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:25:40.903453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:25:40.903453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:25:40.903453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:25:40.903453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:25:40.903453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:25:40.903453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:25:40.903453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:25:40.903453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fea1aa0-032e-454d-9358-98a81cd5d650 could not be found. Sep 06 21:25:40.903453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:25:40.903453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:25:40.903453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:25:40.903453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:25:40.903453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:25:40.903453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:25:40.903453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:25:40.903453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:25:40.903453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:25:40.904759 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:25:40.904759 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:25:40.904759 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:25:40.904759 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:25:40.904759 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:25:40.904759 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:25:40.904759 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:25:40.904759 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fea1aa0-032e-454d-9358-98a81cd5d650 could not be found. Sep 06 21:25:40.904759 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:25:40.904759 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:25:40.904759 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:25:40.904759 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:25:40.904759 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:25:40.904759 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:25:40.904759 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:25:40.904759 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:25:40.904759 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fea1aa0-032e-454d-9358-98a81cd5d650 could not be found. Sep 06 21:25:40.904759 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:25:40.906017 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9d228342-a61b-4218-8331-2eba41f58b4f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] Returning 404 to user: Instance 8fea1aa0-032e-454d-9358-98a81cd5d650 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:25:40.906017 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9d228342-a61b-4218-8331-2eba41f58b4f tempest-AttachVolumeShelveTestJSON-66209968 tempest-AttachVolumeShelveTestJSON-66209968-project] 10.222.0.79 "GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650" status: 404 len: 111 microversion: 2.20 time: 0.032422 Sep 06 21:25:40.906017 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 575/1142] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Sep 6 21:25:40 2022] GET /compute/v2.1/servers/8fea1aa0-032e-454d-9358-98a81cd5d650 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 21:25:40.946189 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6e01b59a-794e-4bfe-9107-9d7076ca4b3d tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:25:40.954664 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6e01b59a-794e-4bfe-9107-9d7076ca4b3d tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb" status: 200 len: 1213 microversion: 2.1 time: 0.068573 Sep 06 21:25:40.956044 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 568/1143] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:25:40 2022] GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:25:41.978178 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3e625b93-6d66-41cf-a054-4ba9fe6c8c72 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:25:41.979726 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3e625b93-6d66-41cf-a054-4ba9fe6c8c72 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: ae214669-ef86-4fe1-aab8-2f83b53b96fb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:25:41.987861 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e625b93-6d66-41cf-a054-4ba9fe6c8c72 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:41.988350 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e625b93-6d66-41cf-a054-4ba9fe6c8c72 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:41.988817 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e625b93-6d66-41cf-a054-4ba9fe6c8c72 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:41.989841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e625b93-6d66-41cf-a054-4ba9fe6c8c72 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:41.990301 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e625b93-6d66-41cf-a054-4ba9fe6c8c72 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:41.990729 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3e625b93-6d66-41cf-a054-4ba9fe6c8c72 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:42.077259 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3e625b93-6d66-41cf-a054-4ba9fe6c8c72 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:25:42.087120 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3e625b93-6d66-41cf-a054-4ba9fe6c8c72 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb" status: 200 len: 1265 microversion: 2.1 time: 0.112465 Sep 06 21:25:42.087969 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 576/1144] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:25:41 2022] GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb => generated 1265 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:25:43.111756 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9b21d0d6-9dd8-4f81-b62a-8dce1213c8d1 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:25:43.113142 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9b21d0d6-9dd8-4f81-b62a-8dce1213c8d1 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: ae214669-ef86-4fe1-aab8-2f83b53b96fb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:25:43.131665 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b21d0d6-9dd8-4f81-b62a-8dce1213c8d1 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:43.132961 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b21d0d6-9dd8-4f81-b62a-8dce1213c8d1 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:43.134337 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b21d0d6-9dd8-4f81-b62a-8dce1213c8d1 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:43.136616 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b21d0d6-9dd8-4f81-b62a-8dce1213c8d1 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:43.138375 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b21d0d6-9dd8-4f81-b62a-8dce1213c8d1 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:43.140096 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b21d0d6-9dd8-4f81-b62a-8dce1213c8d1 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:43.366513 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9b21d0d6-9dd8-4f81-b62a-8dce1213c8d1 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:25:43.377945 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9b21d0d6-9dd8-4f81-b62a-8dce1213c8d1 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb" status: 200 len: 1313 microversion: 2.1 time: 0.270072 Sep 06 21:25:43.380999 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 569/1145] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:25:43 2022] GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:25:44.077392 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-b0e3b875-d894-4517-8a17-0a6ead1f6828 req-67dfbe04-807e-48ed-bf3d-5e3056680210 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae214669-ef86-4fe1-aab8-2f83b53b96fb", "tag": "6fec8690-7e34-48fd-9d1e-d72a6cdb88b5"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:25:44.095170 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b0e3b875-d894-4517-8a17-0a6ead1f6828 req-67dfbe04-807e-48ed-bf3d-5e3056680210 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:44.095805 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b0e3b875-d894-4517-8a17-0a6ead1f6828 req-67dfbe04-807e-48ed-bf3d-5e3056680210 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:44.096547 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b0e3b875-d894-4517-8a17-0a6ead1f6828 req-67dfbe04-807e-48ed-bf3d-5e3056680210 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:44.115978 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-b0e3b875-d894-4517-8a17-0a6ead1f6828 req-67dfbe04-807e-48ed-bf3d-5e3056680210 service nova] Creating event network-changed:6fec8690-7e34-48fd-9d1e-d72a6cdb88b5 for instance ae214669-ef86-4fe1-aab8-2f83b53b96fb on hv-cinder-74915 Sep 06 21:25:44.125247 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-b0e3b875-d894-4517-8a17-0a6ead1f6828 req-67dfbe04-807e-48ed-bf3d-5e3056680210 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053103 Sep 06 21:25:44.126812 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 577/1146] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:25:44.404323 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6118a60b-180a-4c6b-bdeb-3e1879c25135 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:25:44.405331 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6118a60b-180a-4c6b-bdeb-3e1879c25135 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: ae214669-ef86-4fe1-aab8-2f83b53b96fb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:25:44.415222 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6118a60b-180a-4c6b-bdeb-3e1879c25135 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:44.415720 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6118a60b-180a-4c6b-bdeb-3e1879c25135 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:44.416157 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6118a60b-180a-4c6b-bdeb-3e1879c25135 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:44.416985 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6118a60b-180a-4c6b-bdeb-3e1879c25135 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:44.417443 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6118a60b-180a-4c6b-bdeb-3e1879c25135 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:44.419065 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6118a60b-180a-4c6b-bdeb-3e1879c25135 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:44.696911 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6118a60b-180a-4c6b-bdeb-3e1879c25135 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:25:44.705168 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6118a60b-180a-4c6b-bdeb-3e1879c25135 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb" status: 200 len: 1313 microversion: 2.1 time: 0.305903 Sep 06 21:25:44.705750 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 570/1147] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:25:44 2022] GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:25:45.729229 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f33fd3d2-5cd2-4662-98c7-8eae054f7d64 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:25:45.729936 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f33fd3d2-5cd2-4662-98c7-8eae054f7d64 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: ae214669-ef86-4fe1-aab8-2f83b53b96fb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:25:45.737018 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f33fd3d2-5cd2-4662-98c7-8eae054f7d64 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:45.737416 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f33fd3d2-5cd2-4662-98c7-8eae054f7d64 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:45.737868 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f33fd3d2-5cd2-4662-98c7-8eae054f7d64 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:45.738582 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f33fd3d2-5cd2-4662-98c7-8eae054f7d64 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:45.739029 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f33fd3d2-5cd2-4662-98c7-8eae054f7d64 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:45.739500 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f33fd3d2-5cd2-4662-98c7-8eae054f7d64 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:45.882993 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f33fd3d2-5cd2-4662-98c7-8eae054f7d64 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:25:45.891204 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f33fd3d2-5cd2-4662-98c7-8eae054f7d64 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb" status: 200 len: 1313 microversion: 2.1 time: 0.166362 Sep 06 21:25:45.891969 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 578/1148] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:25:45 2022] GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:25:46.914676 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6ceb2cb1-e705-4332-85b7-882b49e9304f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:25:46.920480 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6ceb2cb1-e705-4332-85b7-882b49e9304f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: ae214669-ef86-4fe1-aab8-2f83b53b96fb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:25:46.922011 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ceb2cb1-e705-4332-85b7-882b49e9304f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:46.923319 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ceb2cb1-e705-4332-85b7-882b49e9304f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:46.923319 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ceb2cb1-e705-4332-85b7-882b49e9304f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:46.923574 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ceb2cb1-e705-4332-85b7-882b49e9304f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:46.924051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ceb2cb1-e705-4332-85b7-882b49e9304f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:46.924471 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ceb2cb1-e705-4332-85b7-882b49e9304f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:47.075715 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6ceb2cb1-e705-4332-85b7-882b49e9304f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:25:47.083765 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6ceb2cb1-e705-4332-85b7-882b49e9304f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb" status: 200 len: 1313 microversion: 2.1 time: 0.173044 Sep 06 21:25:47.084099 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 571/1149] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:25:46 2022] GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:25:48.106844 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3a0e2f91-d5b5-4134-ac3d-4cd1679fc6c7 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:25:48.107906 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3a0e2f91-d5b5-4134-ac3d-4cd1679fc6c7 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: ae214669-ef86-4fe1-aab8-2f83b53b96fb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:25:48.114598 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a0e2f91-d5b5-4134-ac3d-4cd1679fc6c7 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:48.115071 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a0e2f91-d5b5-4134-ac3d-4cd1679fc6c7 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:48.115703 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a0e2f91-d5b5-4134-ac3d-4cd1679fc6c7 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:48.116412 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a0e2f91-d5b5-4134-ac3d-4cd1679fc6c7 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:48.116881 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a0e2f91-d5b5-4134-ac3d-4cd1679fc6c7 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:48.117296 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a0e2f91-d5b5-4134-ac3d-4cd1679fc6c7 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:48.262216 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3a0e2f91-d5b5-4134-ac3d-4cd1679fc6c7 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:25:48.271454 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3a0e2f91-d5b5-4134-ac3d-4cd1679fc6c7 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb" status: 200 len: 1313 microversion: 2.1 time: 0.168869 Sep 06 21:25:48.272201 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 579/1150] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:25:48 2022] GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:25:49.296598 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8e274baf-d5f8-4de0-89fc-fc939d42fbed tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:25:49.297243 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8e274baf-d5f8-4de0-89fc-fc939d42fbed tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: ae214669-ef86-4fe1-aab8-2f83b53b96fb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:25:49.304181 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e274baf-d5f8-4de0-89fc-fc939d42fbed tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:49.304719 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e274baf-d5f8-4de0-89fc-fc939d42fbed tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:49.305148 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e274baf-d5f8-4de0-89fc-fc939d42fbed tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:49.305870 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e274baf-d5f8-4de0-89fc-fc939d42fbed tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:49.306312 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e274baf-d5f8-4de0-89fc-fc939d42fbed tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:49.306762 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e274baf-d5f8-4de0-89fc-fc939d42fbed tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:49.451324 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8e274baf-d5f8-4de0-89fc-fc939d42fbed tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:25:49.462291 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8e274baf-d5f8-4de0-89fc-fc939d42fbed tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb" status: 200 len: 1313 microversion: 2.1 time: 0.170550 Sep 06 21:25:49.463575 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 572/1151] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:25:49 2022] GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:25:50.488052 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a5b95d59-d02b-4f30-873a-296cdb706f5b tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:25:50.488687 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a5b95d59-d02b-4f30-873a-296cdb706f5b tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: ae214669-ef86-4fe1-aab8-2f83b53b96fb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:25:50.496277 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5b95d59-d02b-4f30-873a-296cdb706f5b tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:50.496788 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5b95d59-d02b-4f30-873a-296cdb706f5b tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:50.497210 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5b95d59-d02b-4f30-873a-296cdb706f5b tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:50.497910 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5b95d59-d02b-4f30-873a-296cdb706f5b tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:50.498353 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5b95d59-d02b-4f30-873a-296cdb706f5b tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:50.498777 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a5b95d59-d02b-4f30-873a-296cdb706f5b tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:50.639422 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a5b95d59-d02b-4f30-873a-296cdb706f5b tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:25:50.647519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a5b95d59-d02b-4f30-873a-296cdb706f5b tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb" status: 200 len: 1313 microversion: 2.1 time: 0.163866 Sep 06 21:25:50.648060 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 580/1152] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:25:50 2022] GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:25:51.496541 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-61546de7-b280-47b6-bf69-a90a368c863d req-de5788ac-cae8-4434-8cb3-f88cf150dd64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae214669-ef86-4fe1-aab8-2f83b53b96fb", "name": "network-vif-plugged", "status": "completed", "tag": "6fec8690-7e34-48fd-9d1e-d72a6cdb88b5"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:25:51.503163 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:25:51.503883 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=8 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:25:51.511328 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-61546de7-b280-47b6-bf69-a90a368c863d req-de5788ac-cae8-4434-8cb3-f88cf150dd64 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:51.511847 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-61546de7-b280-47b6-bf69-a90a368c863d req-de5788ac-cae8-4434-8cb3-f88cf150dd64 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:51.512279 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-61546de7-b280-47b6-bf69-a90a368c863d req-de5788ac-cae8-4434-8cb3-f88cf150dd64 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:51.527699 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-61546de7-b280-47b6-bf69-a90a368c863d req-de5788ac-cae8-4434-8cb3-f88cf150dd64 service nova] Creating event network-vif-plugged:6fec8690-7e34-48fd-9d1e-d72a6cdb88b5 for instance ae214669-ef86-4fe1-aab8-2f83b53b96fb on hv-cinder-74915 Sep 06 21:25:51.533268 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-61546de7-b280-47b6-bf69-a90a368c863d req-de5788ac-cae8-4434-8cb3-f88cf150dd64 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041123 Sep 06 21:25:51.534091 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 573/1153] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:25:51.675318 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dcc0f980-8af6-4aa8-b9b1-9aef163733ee tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:25:51.676798 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dcc0f980-8af6-4aa8-b9b1-9aef163733ee tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: ae214669-ef86-4fe1-aab8-2f83b53b96fb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:25:51.691450 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dcc0f980-8af6-4aa8-b9b1-9aef163733ee tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:51.692271 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dcc0f980-8af6-4aa8-b9b1-9aef163733ee tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:51.693012 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dcc0f980-8af6-4aa8-b9b1-9aef163733ee tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:51.693842 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dcc0f980-8af6-4aa8-b9b1-9aef163733ee tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:51.694344 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dcc0f980-8af6-4aa8-b9b1-9aef163733ee tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:51.694857 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dcc0f980-8af6-4aa8-b9b1-9aef163733ee tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:51.837530 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-dcc0f980-8af6-4aa8-b9b1-9aef163733ee tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:25:51.846010 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dcc0f980-8af6-4aa8-b9b1-9aef163733ee tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb" status: 200 len: 1313 microversion: 2.1 time: 0.179052 Sep 06 21:25:51.846542 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 581/1154] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:25:51 2022] GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:25:52.870660 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-49bdf8d9-6c2d-4de3-aff7-9fccb8bc5cb8 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:25:52.871508 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-49bdf8d9-6c2d-4de3-aff7-9fccb8bc5cb8 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: ae214669-ef86-4fe1-aab8-2f83b53b96fb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:25:52.878002 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49bdf8d9-6c2d-4de3-aff7-9fccb8bc5cb8 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:52.878484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49bdf8d9-6c2d-4de3-aff7-9fccb8bc5cb8 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:52.878921 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49bdf8d9-6c2d-4de3-aff7-9fccb8bc5cb8 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:52.879624 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49bdf8d9-6c2d-4de3-aff7-9fccb8bc5cb8 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:52.880683 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49bdf8d9-6c2d-4de3-aff7-9fccb8bc5cb8 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:52.880959 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49bdf8d9-6c2d-4de3-aff7-9fccb8bc5cb8 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:53.017804 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-49bdf8d9-6c2d-4de3-aff7-9fccb8bc5cb8 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:25:53.026434 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-49bdf8d9-6c2d-4de3-aff7-9fccb8bc5cb8 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb" status: 200 len: 1313 microversion: 2.1 time: 0.160585 Sep 06 21:25:53.027197 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 574/1155] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:25:52 2022] GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:25:54.050615 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f1ecbb8b-eb0f-43a7-a5cc-3cc9abb69f5f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:25:54.051277 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f1ecbb8b-eb0f-43a7-a5cc-3cc9abb69f5f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: ae214669-ef86-4fe1-aab8-2f83b53b96fb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:25:54.058346 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1ecbb8b-eb0f-43a7-a5cc-3cc9abb69f5f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:54.058828 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1ecbb8b-eb0f-43a7-a5cc-3cc9abb69f5f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:54.059304 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1ecbb8b-eb0f-43a7-a5cc-3cc9abb69f5f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:54.059997 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1ecbb8b-eb0f-43a7-a5cc-3cc9abb69f5f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:54.060438 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1ecbb8b-eb0f-43a7-a5cc-3cc9abb69f5f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:54.060885 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1ecbb8b-eb0f-43a7-a5cc-3cc9abb69f5f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:54.203681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f1ecbb8b-eb0f-43a7-a5cc-3cc9abb69f5f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:25:54.211808 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f1ecbb8b-eb0f-43a7-a5cc-3cc9abb69f5f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb" status: 200 len: 1496 microversion: 2.1 time: 0.165165 Sep 06 21:25:54.212379 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 582/1156] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:25:54 2022] GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb => generated 1496 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:25:54.805737 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-05407818-37bd-421e-8cc2-873dbcdc8e4f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:25:54.806341 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-05407818-37bd-421e-8cc2-873dbcdc8e4f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: ae214669-ef86-4fe1-aab8-2f83b53b96fb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:25:54.814047 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05407818-37bd-421e-8cc2-873dbcdc8e4f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:54.814529 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05407818-37bd-421e-8cc2-873dbcdc8e4f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:54.815014 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05407818-37bd-421e-8cc2-873dbcdc8e4f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:54.815753 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05407818-37bd-421e-8cc2-873dbcdc8e4f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:54.816214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05407818-37bd-421e-8cc2-873dbcdc8e4f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:54.816630 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05407818-37bd-421e-8cc2-873dbcdc8e4f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:54.844839 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-05407818-37bd-421e-8cc2-873dbcdc8e4f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: ae214669-ef86-4fe1-aab8-2f83b53b96fb] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 21:25:54.933364 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-05407818-37bd-421e-8cc2-873dbcdc8e4f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb" status: 204 len: 0 microversion: 2.1 time: 0.130797 Sep 06 21:25:54.933761 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 575/1157] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Sep 6 21:25:54 2022] DELETE /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 21:25:54.944485 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6b0c2900-0d89-42b3-9b17-ba272fb2645c tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:25:54.945212 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6b0c2900-0d89-42b3-9b17-ba272fb2645c tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: ae214669-ef86-4fe1-aab8-2f83b53b96fb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:25:54.951829 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b0c2900-0d89-42b3-9b17-ba272fb2645c tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:54.952380 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b0c2900-0d89-42b3-9b17-ba272fb2645c tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:54.953069 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b0c2900-0d89-42b3-9b17-ba272fb2645c tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:54.953970 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b0c2900-0d89-42b3-9b17-ba272fb2645c tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:54.954421 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b0c2900-0d89-42b3-9b17-ba272fb2645c tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:54.954847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b0c2900-0d89-42b3-9b17-ba272fb2645c tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:55.135075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6b0c2900-0d89-42b3-9b17-ba272fb2645c tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:25:55.143895 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6b0c2900-0d89-42b3-9b17-ba272fb2645c tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb" status: 200 len: 1502 microversion: 2.1 time: 0.204234 Sep 06 21:25:55.144453 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 583/1158] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:25:54 2022] GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb => generated 1502 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:25:56.168922 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fd3f4875-685a-4a88-b9a1-44b500495cfb tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:25:56.169769 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fd3f4875-685a-4a88-b9a1-44b500495cfb tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: ae214669-ef86-4fe1-aab8-2f83b53b96fb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:25:56.177212 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd3f4875-685a-4a88-b9a1-44b500495cfb tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:56.177747 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd3f4875-685a-4a88-b9a1-44b500495cfb tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:56.178185 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd3f4875-685a-4a88-b9a1-44b500495cfb tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:56.178999 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd3f4875-685a-4a88-b9a1-44b500495cfb tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:56.179471 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd3f4875-685a-4a88-b9a1-44b500495cfb tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:56.179922 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd3f4875-685a-4a88-b9a1-44b500495cfb tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:56.324287 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fd3f4875-685a-4a88-b9a1-44b500495cfb tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:25:56.332271 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fd3f4875-685a-4a88-b9a1-44b500495cfb tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb" status: 200 len: 1502 microversion: 2.1 time: 0.168432 Sep 06 21:25:56.332934 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 576/1159] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:25:56 2022] GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb => generated 1502 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:25:57.192582 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-2659becb-1112-42f8-bedd-37c1b17879a1 req-3a710c36-1053-4a56-be47-97104b1bccd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae214669-ef86-4fe1-aab8-2f83b53b96fb", "name": "network-vif-deleted", "tag": "6fec8690-7e34-48fd-9d1e-d72a6cdb88b5"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:25:57.204004 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2659becb-1112-42f8-bedd-37c1b17879a1 req-3a710c36-1053-4a56-be47-97104b1bccd4 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:57.204598 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2659becb-1112-42f8-bedd-37c1b17879a1 req-3a710c36-1053-4a56-be47-97104b1bccd4 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:57.205147 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2659becb-1112-42f8-bedd-37c1b17879a1 req-3a710c36-1053-4a56-be47-97104b1bccd4 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:57.224734 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-2659becb-1112-42f8-bedd-37c1b17879a1 req-3a710c36-1053-4a56-be47-97104b1bccd4 service nova] Creating event network-vif-deleted:6fec8690-7e34-48fd-9d1e-d72a6cdb88b5 for instance ae214669-ef86-4fe1-aab8-2f83b53b96fb on hv-cinder-74915 Sep 06 21:25:57.228966 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-2659becb-1112-42f8-bedd-37c1b17879a1 req-3a710c36-1053-4a56-be47-97104b1bccd4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039359 Sep 06 21:25:57.230609 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 584/1160] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:25:57.357122 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8c716c49-c420-4422-b785-a32ecb0d7bdf tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:25:57.357841 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8c716c49-c420-4422-b785-a32ecb0d7bdf tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: ae214669-ef86-4fe1-aab8-2f83b53b96fb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:25:57.368016 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c716c49-c420-4422-b785-a32ecb0d7bdf tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:57.368516 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c716c49-c420-4422-b785-a32ecb0d7bdf tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:57.368971 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c716c49-c420-4422-b785-a32ecb0d7bdf tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:57.369685 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c716c49-c420-4422-b785-a32ecb0d7bdf tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:57.370125 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c716c49-c420-4422-b785-a32ecb0d7bdf tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:57.370541 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c716c49-c420-4422-b785-a32ecb0d7bdf tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:57.409166 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c716c49-c420-4422-b785-a32ecb0d7bdf tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:57.409648 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c716c49-c420-4422-b785-a32ecb0d7bdf tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:57.410080 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c716c49-c420-4422-b785-a32ecb0d7bdf tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:57.410529 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-8c716c49-c420-4422-b785-a32ecb0d7bdf tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lazy-loading 'fault' on Instance uuid ae214669-ef86-4fe1-aab8-2f83b53b96fb {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:25:57.455612 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8c716c49-c420-4422-b785-a32ecb0d7bdf tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:25:57.464493 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8c716c49-c420-4422-b785-a32ecb0d7bdf tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb" status: 200 len: 1303 microversion: 2.1 time: 0.111733 Sep 06 21:25:57.465078 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 577/1161] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:25:57 2022] GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb => generated 1303 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:25:58.490284 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-afece5d5-091d-4555-8a98-6c6d75736183 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:25:58.491387 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-afece5d5-091d-4555-8a98-6c6d75736183 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: ae214669-ef86-4fe1-aab8-2f83b53b96fb] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:25:58.499197 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afece5d5-091d-4555-8a98-6c6d75736183 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:58.499706 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afece5d5-091d-4555-8a98-6c6d75736183 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:58.500135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afece5d5-091d-4555-8a98-6c6d75736183 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:58.500880 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afece5d5-091d-4555-8a98-6c6d75736183 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:58.501333 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afece5d5-091d-4555-8a98-6c6d75736183 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:58.501750 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afece5d5-091d-4555-8a98-6c6d75736183 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:58.515791 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-afece5d5-091d-4555-8a98-6c6d75736183 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] HTTP exception thrown: Instance ae214669-ef86-4fe1-aab8-2f83b53b96fb could not be found. Sep 06 21:25:58.517713 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-afece5d5-091d-4555-8a98-6c6d75736183 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Request method failure captured: Sep 06 21:25:58.517713 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb HTTP/1.1 Sep 06 21:25:58.517713 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:25:58.517713 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:25:58.517713 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:25:58.517713 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:25:58.517713 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:25:58.517713 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:25:58.517713 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:25:58.517713 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:25:58.517713 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7rSab5-cUkdP02aMO3KU6b2E2usoN2BQVa4y-_qbnhvnsTS7xmT4x7Cexuin6jio5qi-LAjbSgbTgexw-cwAWKWqqOS8Lc4u3gFIV9HbbDQm33boEg3LvP-LakOLAYD2xJAksDediRGeX-Ugrp4y-O4jImuPfpc_VNrei6WcTQlrcA Sep 06 21:25:58.517713 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:25:58.517713 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:25:58.517713 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:25:58.517713 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:25:58.517713 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:25:58.517713 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:25:58.517713 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: 8c3a88bdee6e4566987b3e87b4627ca6 Sep 06 21:25:58.517713 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesActionsTest-850348177 Sep 06 21:25:58.517713 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:25:58.517713 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:25:58.519835 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8c3a88bdee6e4566987b3e87b4627ca6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8c3a88bdee6e4566987b3e87b4627ca6", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c3a88bdee6e4566987b3e87b4627ca6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c3a88bdee6e4566987b3e87b4627ca6"}]}] Sep 06 21:25:58.519835 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-VolumesActionsTest-850348177 Sep 06 21:25:58.519835 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 8c3a88bdee6e4566987b3e87b4627ca6 Sep 06 21:25:58.519835 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesActionsTest-850348177 Sep 06 21:25:58.519835 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-VolumesActionsTest-850348177-project Sep 06 21:25:58.519835 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:25:58.519835 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:25:58.519835 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: 525ba710ef8b40d0abb27bb2cad1095c Sep 06 21:25:58.519835 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-VolumesActionsTest-850348177-project Sep 06 21:25:58.519835 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: > Sep 06 21:25:58.519835 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Instance ae214669-ef86-4fe1-aab8-2f83b53b96fb could not be found. Sep 06 21:25:58.519835 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'id': 'ae214669-ef86-4fe1-aab8-2f83b53b96fb'} Sep 06 21:25:58.521841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:25:58.521841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:25:58.521841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:25:58.521841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:25:58.521841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:25:58.521841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:25:58.521841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:25:58.521841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:25:58.521841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:25:58.521841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:25:58.521841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae214669-ef86-4fe1-aab8-2f83b53b96fb could not be found. Sep 06 21:25:58.521841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:25:58.521841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:25:58.521841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:25:58.521841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:25:58.521841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:25:58.521841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:25:58.521841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:25:58.521841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:25:58.521841 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:25:58.523595 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:25:58.523595 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:25:58.523595 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:25:58.523595 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:25:58.523595 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:25:58.523595 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:25:58.523595 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:25:58.523595 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae214669-ef86-4fe1-aab8-2f83b53b96fb could not be found. Sep 06 21:25:58.523595 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:25:58.523595 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:25:58.523595 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:25:58.523595 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:25:58.523595 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:25:58.523595 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:25:58.523595 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:25:58.523595 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:25:58.523595 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae214669-ef86-4fe1-aab8-2f83b53b96fb could not be found. Sep 06 21:25:58.523595 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:25:58.525446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-afece5d5-091d-4555-8a98-6c6d75736183 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Returning 404 to user: Instance ae214669-ef86-4fe1-aab8-2f83b53b96fb could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:25:58.525446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-afece5d5-091d-4555-8a98-6c6d75736183 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb" status: 404 len: 111 microversion: 2.1 time: 0.034257 Sep 06 21:25:58.525446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 585/1162] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:25:58 2022] GET /compute/v2.1/servers/ae214669-ef86-4fe1-aab8-2f83b53b96fb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:25:58.640709 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-928bbc9b-bc4c-44ee-afdc-f64d814b0b46 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-166284430", "imageRef": "8b4a7612-517c-4711-8637-36b221338f65", "flavorRef": "452", "networks": [{"uuid": "ae9ccc66-7409-4d24-9a32-6f7c395b5589"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:25:58.701749 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-928bbc9b-bc4c-44ee-afdc-f64d814b0b46 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] validate_networks() for [('ae9ccc66-7409-4d24-9a32-6f7c395b5589', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 21:25:59.186977 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-928bbc9b-bc4c-44ee-afdc-f64d814b0b46 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 21:25:59.187399 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-928bbc9b-bc4c-44ee-afdc-f64d814b0b46 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 21:25:59.187874 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-928bbc9b-bc4c-44ee-afdc-f64d814b0b46 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 21:25:59.188275 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-928bbc9b-bc4c-44ee-afdc-f64d814b0b46 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 21:25:59.189195 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-928bbc9b-bc4c-44ee-afdc-f64d814b0b46 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 21:25:59.199409 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-928bbc9b-bc4c-44ee-afdc-f64d814b0b46 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:59.200056 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-928bbc9b-bc4c-44ee-afdc-f64d814b0b46 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:59.200484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-928bbc9b-bc4c-44ee-afdc-f64d814b0b46 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:59.201261 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-928bbc9b-bc4c-44ee-afdc-f64d814b0b46 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:25:59.201729 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-928bbc9b-bc4c-44ee-afdc-f64d814b0b46 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:25:59.202198 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-928bbc9b-bc4c-44ee-afdc-f64d814b0b46 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:25:59.220069 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-928bbc9b-bc4c-44ee-afdc-f64d814b0b46 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Getting quotas for project 8c3a88bdee6e4566987b3e87b4627ca6. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:25:59.224279 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-928bbc9b-bc4c-44ee-afdc-f64d814b0b46 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Getting quotas for user 525ba710ef8b40d0abb27bb2cad1095c and project 8c3a88bdee6e4566987b3e87b4627ca6. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:25:59.235572 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-928bbc9b-bc4c-44ee-afdc-f64d814b0b46 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 21:25:59.237900 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-928bbc9b-bc4c-44ee-afdc-f64d814b0b46 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: c529da9e-51d1-43a0-8065-cf16d00ae5b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8b4a7612-517c-4711-8637-36b221338f65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 21:25:59.299290 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-928bbc9b-bc4c-44ee-afdc-f64d814b0b46 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663534 Sep 06 21:25:59.300506 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 578/1163] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Sep 6 21:25:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 21:25:59.312272 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6bb035d0-8c1a-4351-afd7-1ea9c8751c76 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:25:59.313173 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6bb035d0-8c1a-4351-afd7-1ea9c8751c76 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: c529da9e-51d1-43a0-8065-cf16d00ae5b3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:25:59.397619 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6bb035d0-8c1a-4351-afd7-1ea9c8751c76 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:25:59.404943 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6bb035d0-8c1a-4351-afd7-1ea9c8751c76 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3" status: 200 len: 1213 microversion: 2.1 time: 0.096788 Sep 06 21:25:59.405853 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 586/1164] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:25:59 2022] GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3 => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:00.430315 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-62343653-31d8-4bc1-8d9a-ea0489057063 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:00.430955 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-62343653-31d8-4bc1-8d9a-ea0489057063 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: c529da9e-51d1-43a0-8065-cf16d00ae5b3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:00.437699 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62343653-31d8-4bc1-8d9a-ea0489057063 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:00.438249 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62343653-31d8-4bc1-8d9a-ea0489057063 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:00.438752 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62343653-31d8-4bc1-8d9a-ea0489057063 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:00.439534 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62343653-31d8-4bc1-8d9a-ea0489057063 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:00.440040 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62343653-31d8-4bc1-8d9a-ea0489057063 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:00.440703 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62343653-31d8-4bc1-8d9a-ea0489057063 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:00.510485 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-62343653-31d8-4bc1-8d9a-ea0489057063 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:00.514206 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:26:00.519824 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-62343653-31d8-4bc1-8d9a-ea0489057063 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3" status: 200 len: 1265 microversion: 2.1 time: 0.094100 Sep 06 21:26:00.520406 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 579/1165] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:00 2022] GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3 => generated 1265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:01.543835 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fffd5f93-5998-4284-8bfe-d65a7ee04176 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:01.544479 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fffd5f93-5998-4284-8bfe-d65a7ee04176 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: c529da9e-51d1-43a0-8065-cf16d00ae5b3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:01.554174 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fffd5f93-5998-4284-8bfe-d65a7ee04176 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:01.554675 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fffd5f93-5998-4284-8bfe-d65a7ee04176 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:01.555118 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fffd5f93-5998-4284-8bfe-d65a7ee04176 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:01.555999 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fffd5f93-5998-4284-8bfe-d65a7ee04176 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:01.556480 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fffd5f93-5998-4284-8bfe-d65a7ee04176 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:01.556974 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fffd5f93-5998-4284-8bfe-d65a7ee04176 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:01.635578 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-fffd5f93-5998-4284-8bfe-d65a7ee04176 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:01.644921 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fffd5f93-5998-4284-8bfe-d65a7ee04176 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3" status: 200 len: 1271 microversion: 2.1 time: 0.105419 Sep 06 21:26:01.645630 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 587/1166] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:01 2022] GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3 => generated 1271 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:26:02.651290 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-888aa7eb-fbe4-47cb-8d27-0d8f28c2774b req-7416436f-568e-4a6b-8bfe-7d55732c0eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c529da9e-51d1-43a0-8065-cf16d00ae5b3", "tag": "631fc78f-f97c-4d80-92b4-99246dc669ca"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:26:02.665920 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-888aa7eb-fbe4-47cb-8d27-0d8f28c2774b req-7416436f-568e-4a6b-8bfe-7d55732c0eb1 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:02.666930 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-888aa7eb-fbe4-47cb-8d27-0d8f28c2774b req-7416436f-568e-4a6b-8bfe-7d55732c0eb1 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:02.668524 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-888aa7eb-fbe4-47cb-8d27-0d8f28c2774b req-7416436f-568e-4a6b-8bfe-7d55732c0eb1 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:02.669809 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9fa89ebf-a9d6-4757-a228-e035a484f129 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:02.672516 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9fa89ebf-a9d6-4757-a228-e035a484f129 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: c529da9e-51d1-43a0-8065-cf16d00ae5b3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:02.681230 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:26:02.686898 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-888aa7eb-fbe4-47cb-8d27-0d8f28c2774b req-7416436f-568e-4a6b-8bfe-7d55732c0eb1 service nova] Creating event network-changed:631fc78f-f97c-4d80-92b4-99246dc669ca for instance c529da9e-51d1-43a0-8065-cf16d00ae5b3 on hv-cinder-74915 Sep 06 21:26:02.689813 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9fa89ebf-a9d6-4757-a228-e035a484f129 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:02.690507 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9fa89ebf-a9d6-4757-a228-e035a484f129 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:02.691249 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9fa89ebf-a9d6-4757-a228-e035a484f129 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:02.692111 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9fa89ebf-a9d6-4757-a228-e035a484f129 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:02.692763 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9fa89ebf-a9d6-4757-a228-e035a484f129 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:02.693185 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9fa89ebf-a9d6-4757-a228-e035a484f129 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:02.694861 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-888aa7eb-fbe4-47cb-8d27-0d8f28c2774b req-7416436f-568e-4a6b-8bfe-7d55732c0eb1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047715 Sep 06 21:26:02.697812 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=87 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:26:02.702007 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 580/1167] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:26:02.881420 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9fa89ebf-a9d6-4757-a228-e035a484f129 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:02.892124 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9fa89ebf-a9d6-4757-a228-e035a484f129 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3" status: 200 len: 1313 microversion: 2.1 time: 0.227290 Sep 06 21:26:02.893852 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 588/1168] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:02 2022] GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:03.921250 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e0ad8d05-2eb8-49e7-ad56-93998536af5f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:03.921946 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e0ad8d05-2eb8-49e7-ad56-93998536af5f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: c529da9e-51d1-43a0-8065-cf16d00ae5b3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:03.923950 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:26:03.929438 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e0ad8d05-2eb8-49e7-ad56-93998536af5f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:03.929909 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e0ad8d05-2eb8-49e7-ad56-93998536af5f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:03.930337 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e0ad8d05-2eb8-49e7-ad56-93998536af5f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:03.931033 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e0ad8d05-2eb8-49e7-ad56-93998536af5f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:03.931469 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e0ad8d05-2eb8-49e7-ad56-93998536af5f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:03.931868 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e0ad8d05-2eb8-49e7-ad56-93998536af5f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:04.072890 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e0ad8d05-2eb8-49e7-ad56-93998536af5f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:04.081267 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e0ad8d05-2eb8-49e7-ad56-93998536af5f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3" status: 200 len: 1313 microversion: 2.1 time: 0.165187 Sep 06 21:26:04.081875 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 581/1169] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:03 2022] GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:05.104650 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d4fcb960-5427-49e5-85aa-6258db8e601f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:05.105273 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d4fcb960-5427-49e5-85aa-6258db8e601f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: c529da9e-51d1-43a0-8065-cf16d00ae5b3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:05.112401 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4fcb960-5427-49e5-85aa-6258db8e601f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:05.112915 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4fcb960-5427-49e5-85aa-6258db8e601f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:05.113347 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4fcb960-5427-49e5-85aa-6258db8e601f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:05.114052 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4fcb960-5427-49e5-85aa-6258db8e601f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:05.114499 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4fcb960-5427-49e5-85aa-6258db8e601f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:05.115222 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4fcb960-5427-49e5-85aa-6258db8e601f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:05.256464 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d4fcb960-5427-49e5-85aa-6258db8e601f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:05.265463 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d4fcb960-5427-49e5-85aa-6258db8e601f tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3" status: 200 len: 1313 microversion: 2.1 time: 0.164823 Sep 06 21:26:05.266232 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 589/1170] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:05 2022] GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:06.290126 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b75201f7-3399-4677-8249-5effe1e3759e tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:06.290723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b75201f7-3399-4677-8249-5effe1e3759e tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: c529da9e-51d1-43a0-8065-cf16d00ae5b3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:06.299160 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b75201f7-3399-4677-8249-5effe1e3759e tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:06.299719 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b75201f7-3399-4677-8249-5effe1e3759e tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:06.300169 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b75201f7-3399-4677-8249-5effe1e3759e tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:06.300915 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b75201f7-3399-4677-8249-5effe1e3759e tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:06.301430 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b75201f7-3399-4677-8249-5effe1e3759e tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:06.301845 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b75201f7-3399-4677-8249-5effe1e3759e tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:06.458159 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b75201f7-3399-4677-8249-5effe1e3759e tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:06.466214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b75201f7-3399-4677-8249-5effe1e3759e tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3" status: 200 len: 1313 microversion: 2.1 time: 0.180105 Sep 06 21:26:06.467121 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 582/1171] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:06 2022] GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:07.489392 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7178ab8a-721d-4d51-8167-4354f70175ce tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:07.490330 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7178ab8a-721d-4d51-8167-4354f70175ce tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: c529da9e-51d1-43a0-8065-cf16d00ae5b3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:07.498720 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7178ab8a-721d-4d51-8167-4354f70175ce tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:07.499248 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7178ab8a-721d-4d51-8167-4354f70175ce tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:07.499824 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7178ab8a-721d-4d51-8167-4354f70175ce tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:07.500671 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7178ab8a-721d-4d51-8167-4354f70175ce tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:07.501136 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7178ab8a-721d-4d51-8167-4354f70175ce tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:07.501566 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7178ab8a-721d-4d51-8167-4354f70175ce tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:07.658162 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7178ab8a-721d-4d51-8167-4354f70175ce tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:07.668038 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7178ab8a-721d-4d51-8167-4354f70175ce tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3" status: 200 len: 1313 microversion: 2.1 time: 0.182116 Sep 06 21:26:07.673900 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 590/1172] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:07 2022] GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:08.693622 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0c85f780-c51d-4753-90b9-e164fda6cc5e tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:08.694208 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0c85f780-c51d-4753-90b9-e164fda6cc5e tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: c529da9e-51d1-43a0-8065-cf16d00ae5b3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:08.701189 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c85f780-c51d-4753-90b9-e164fda6cc5e tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:08.701671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c85f780-c51d-4753-90b9-e164fda6cc5e tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:08.702120 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c85f780-c51d-4753-90b9-e164fda6cc5e tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:08.702819 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c85f780-c51d-4753-90b9-e164fda6cc5e tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:08.703257 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c85f780-c51d-4753-90b9-e164fda6cc5e tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:08.703669 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c85f780-c51d-4753-90b9-e164fda6cc5e tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:08.845265 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0c85f780-c51d-4753-90b9-e164fda6cc5e tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:08.855774 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0c85f780-c51d-4753-90b9-e164fda6cc5e tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3" status: 200 len: 1313 microversion: 2.1 time: 0.166449 Sep 06 21:26:08.856759 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 583/1173] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:08 2022] GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:09.585721 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-b779e7a3-6a1f-4b8a-a340-4f258435dc0c req-d8438b40-9a59-4abe-b7ed-8e2f764289b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c529da9e-51d1-43a0-8065-cf16d00ae5b3", "name": "network-vif-plugged", "status": "completed", "tag": "631fc78f-f97c-4d80-92b4-99246dc669ca"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:26:09.596192 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:26:09.603298 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b779e7a3-6a1f-4b8a-a340-4f258435dc0c req-d8438b40-9a59-4abe-b7ed-8e2f764289b2 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:09.603780 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b779e7a3-6a1f-4b8a-a340-4f258435dc0c req-d8438b40-9a59-4abe-b7ed-8e2f764289b2 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:09.604203 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b779e7a3-6a1f-4b8a-a340-4f258435dc0c req-d8438b40-9a59-4abe-b7ed-8e2f764289b2 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:09.616180 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-b779e7a3-6a1f-4b8a-a340-4f258435dc0c req-d8438b40-9a59-4abe-b7ed-8e2f764289b2 service nova] Creating event network-vif-plugged:631fc78f-f97c-4d80-92b4-99246dc669ca for instance c529da9e-51d1-43a0-8065-cf16d00ae5b3 on hv-cinder-74915 Sep 06 21:26:09.623441 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-b779e7a3-6a1f-4b8a-a340-4f258435dc0c req-d8438b40-9a59-4abe-b7ed-8e2f764289b2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045129 Sep 06 21:26:09.623441 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 591/1174] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:26:09.882224 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bb9692d2-f063-4650-8784-4720cdc15bd5 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:09.882882 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bb9692d2-f063-4650-8784-4720cdc15bd5 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: c529da9e-51d1-43a0-8065-cf16d00ae5b3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:09.884803 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:26:09.885515 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:26:09.893068 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb9692d2-f063-4650-8784-4720cdc15bd5 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:09.893601 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb9692d2-f063-4650-8784-4720cdc15bd5 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:09.894211 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb9692d2-f063-4650-8784-4720cdc15bd5 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:09.895172 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb9692d2-f063-4650-8784-4720cdc15bd5 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:09.895595 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb9692d2-f063-4650-8784-4720cdc15bd5 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:09.896017 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb9692d2-f063-4650-8784-4720cdc15bd5 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:10.061910 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bb9692d2-f063-4650-8784-4720cdc15bd5 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:10.070844 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bb9692d2-f063-4650-8784-4720cdc15bd5 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3" status: 200 len: 1313 microversion: 2.1 time: 0.193107 Sep 06 21:26:10.071448 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 584/1175] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:09 2022] GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:11.094954 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-15d8c273-94ef-435e-8036-0f771647ffbc tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:11.095674 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-15d8c273-94ef-435e-8036-0f771647ffbc tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: c529da9e-51d1-43a0-8065-cf16d00ae5b3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:11.102927 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15d8c273-94ef-435e-8036-0f771647ffbc tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:11.103362 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15d8c273-94ef-435e-8036-0f771647ffbc tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:11.103794 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15d8c273-94ef-435e-8036-0f771647ffbc tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:11.104550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15d8c273-94ef-435e-8036-0f771647ffbc tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:11.104982 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15d8c273-94ef-435e-8036-0f771647ffbc tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:11.105404 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15d8c273-94ef-435e-8036-0f771647ffbc tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:11.263486 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-15d8c273-94ef-435e-8036-0f771647ffbc tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:11.271831 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-15d8c273-94ef-435e-8036-0f771647ffbc tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3" status: 200 len: 1313 microversion: 2.1 time: 0.181431 Sep 06 21:26:11.272815 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 592/1176] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:11 2022] GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:11.360480 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-788903fe-d8db-461d-ad19-6a28c936009c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:11.361034 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-788903fe-d8db-461d-ad19-6a28c936009c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 17b54989-ef84-453f-920e-766847e1d0ed] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:11.367722 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-788903fe-d8db-461d-ad19-6a28c936009c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:11.368235 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-788903fe-d8db-461d-ad19-6a28c936009c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:11.368634 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-788903fe-d8db-461d-ad19-6a28c936009c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:11.369563 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-788903fe-d8db-461d-ad19-6a28c936009c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:11.370012 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-788903fe-d8db-461d-ad19-6a28c936009c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:11.370434 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-788903fe-d8db-461d-ad19-6a28c936009c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:11.395395 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-788903fe-d8db-461d-ad19-6a28c936009c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed/ips" status: 200 len: 150 microversion: 2.1 time: 0.039173 Sep 06 21:26:11.395968 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 585/1177] 10.222.0.79 () {58 vars in 1248 bytes} [Tue Sep 6 21:26:11 2022] GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:26:11.407942 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-52318259-7721-40a5-8670-d942e422fe68 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1e113b7-8142-45e1-afe6-c027eca270d5"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:26:11.410416 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-52318259-7721-40a5-8670-d942e422fe68 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 17b54989-ef84-453f-920e-766847e1d0ed] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:11.416420 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52318259-7721-40a5-8670-d942e422fe68 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:11.416934 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52318259-7721-40a5-8670-d942e422fe68 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:11.417738 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52318259-7721-40a5-8670-d942e422fe68 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:11.418474 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52318259-7721-40a5-8670-d942e422fe68 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:11.418928 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52318259-7721-40a5-8670-d942e422fe68 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:11.419350 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-52318259-7721-40a5-8670-d942e422fe68 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:11.515783 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-52318259-7721-40a5-8670-d942e422fe68 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] HTTP exception thrown: Invalid volume: volume e1e113b7-8142-45e1-afe6-c027eca270d5 is already attached to instances: 84876df2-af4d-4824-a96b-039881a934d3 Sep 06 21:26:11.518135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-52318259-7721-40a5-8670-d942e422fe68 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Request method failure captured: Sep 06 21:26:11.518135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: POST /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed/os-volume_attachments HTTP/1.1 Sep 06 21:26:11.518135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:26:11.518135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:26:11.518135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:26:11.518135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 74 Sep 06 21:26:11.518135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:26:11.518135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:26:11.518135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:26:11.518135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:26:11.518135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7oBRUaWFmUaRMRrY2lmG27XTCe8m7oOenu15JckXMhNFYDIb6s6CTPHxEIINys886U3nqIXNvhOhvtXDn-W2TtU1LkNmSf6teGC7l2Pr1U-HL4_5PeX8X3jMoeu0l-wC_3RYNggU9GitVP5pFTsCQ7cQZQ9cQw1uf_6XEJXvRawCjA Sep 06 21:26:11.518135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:26:11.518135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:26:11.518135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:26:11.518135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:26:11.518135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:26:11.518135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:26:11.518135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: 0ca0b63bd9224370b45e7cc5e9c68a27 Sep 06 21:26:11.518135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:26:11.518135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:26:11.518135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:26:11.519788 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0ca0b63bd9224370b45e7cc5e9c68a27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0ca0b63bd9224370b45e7cc5e9c68a27", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ca0b63bd9224370b45e7cc5e9c68a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ca0b63bd9224370b45e7cc5e9c68a27"}]}] Sep 06 21:26:11.519788 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:26:11.519788 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 0ca0b63bd9224370b45e7cc5e9c68a27 Sep 06 21:26:11.519788 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:26:11.519788 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeNegativeTest-1682827976-project Sep 06 21:26:11.519788 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:26:11.519788 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:26:11.519788 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: e22472efcb9a454688744457cb45eabb Sep 06 21:26:11.519788 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeNegativeTest-1682827976-project Sep 06 21:26:11.519788 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Sep 06 21:26:11.519788 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {"volumeAttachment": {"volumeId": "e1e113b7-8142-45e1-afe6-c027eca270d5"}} Sep 06 21:26:11.519788 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: > Sep 06 21:26:11.524075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Invalid volume: volume e1e113b7-8142-45e1-afe6-c027eca270d5 is already attached to instances: 84876df2-af4d-4824-a96b-039881a934d3 Sep 06 21:26:11.524075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'server_id': '17b54989-ef84-453f-920e-766847e1d0ed', 'body': {'volumeAttachment': {'volumeId': 'e1e113b7-8142-45e1-afe6-c027eca270d5'}}} Sep 06 21:26:11.524075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:26:11.524075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:26:11.524075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 06 21:26:11.524075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 06 21:26:11.524075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 21:26:11.524075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 21:26:11.524075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 06 21:26:11.524075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 21:26:11.524075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 06 21:26:11.524075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 06 21:26:11.524075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 06 21:26:11.524075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 06 21:26:11.524075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e1e113b7-8142-45e1-afe6-c027eca270d5 is already attached to instances: 84876df2-af4d-4824-a96b-039881a934d3 Sep 06 21:26:11.524075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:26:11.524075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:26:11.524075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:26:11.524075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:26:11.526226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:26:11.526226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:26:11.526226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:26:11.526226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:26:11.526226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:26:11.526226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:26:11.526226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 21:26:11.526226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 21:26:11.526226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 21:26:11.526226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 21:26:11.526226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 21:26:11.526226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 21:26:11.526226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 06 21:26:11.526226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 06 21:26:11.526226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e1e113b7-8142-45e1-afe6-c027eca270d5 is already attached to instances: 84876df2-af4d-4824-a96b-039881a934d3 Sep 06 21:26:11.526226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:26:11.526226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:26:11.526226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:26:11.526226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:26:11.526226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:26:11.527741 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:26:11.527741 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:26:11.527741 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:26:11.527741 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e1e113b7-8142-45e1-afe6-c027eca270d5 is already attached to instances: 84876df2-af4d-4824-a96b-039881a934d3 Sep 06 21:26:11.527741 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:26:11.527741 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-52318259-7721-40a5-8670-d942e422fe68 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Returning 400 to user: Invalid volume: volume e1e113b7-8142-45e1-afe6-c027eca270d5 is already attached to instances: 84876df2-af4d-4824-a96b-039881a934d3 {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:26:11.527741 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-52318259-7721-40a5-8670-d942e422fe68 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "POST /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.115769 Sep 06 21:26:11.527741 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 593/1178] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Sep 6 21:26:11 2022] POST /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed/os-volume_attachments => generated 174 bytes in 117 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 06 21:26:11.530504 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7a1cb4ca-18b9-40f1-a2cc-97bcf192b3ac tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:11.531007 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7a1cb4ca-18b9-40f1-a2cc-97bcf192b3ac tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 17b54989-ef84-453f-920e-766847e1d0ed] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:11.537640 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a1cb4ca-18b9-40f1-a2cc-97bcf192b3ac tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:11.538127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a1cb4ca-18b9-40f1-a2cc-97bcf192b3ac tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:11.538562 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a1cb4ca-18b9-40f1-a2cc-97bcf192b3ac tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:11.539280 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a1cb4ca-18b9-40f1-a2cc-97bcf192b3ac tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:11.539727 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a1cb4ca-18b9-40f1-a2cc-97bcf192b3ac tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:11.540150 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a1cb4ca-18b9-40f1-a2cc-97bcf192b3ac tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:11.567020 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7a1cb4ca-18b9-40f1-a2cc-97bcf192b3ac tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 17b54989-ef84-453f-920e-766847e1d0ed] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 21:26:11.652576 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7a1cb4ca-18b9-40f1-a2cc-97bcf192b3ac tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "DELETE /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed" status: 204 len: 0 microversion: 2.1 time: 0.126256 Sep 06 21:26:11.653215 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 586/1179] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Sep 6 21:26:11 2022] DELETE /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 21:26:11.661808 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c3fbe8fa-0713-49b2-999b-59d32fa966ef tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:11.662417 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c3fbe8fa-0713-49b2-999b-59d32fa966ef tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 17b54989-ef84-453f-920e-766847e1d0ed] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:11.669960 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3fbe8fa-0713-49b2-999b-59d32fa966ef tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:11.670490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3fbe8fa-0713-49b2-999b-59d32fa966ef tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:11.670924 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3fbe8fa-0713-49b2-999b-59d32fa966ef tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:11.671660 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3fbe8fa-0713-49b2-999b-59d32fa966ef tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:11.672085 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3fbe8fa-0713-49b2-999b-59d32fa966ef tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:11.672495 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c3fbe8fa-0713-49b2-999b-59d32fa966ef tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:11.885717 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c3fbe8fa-0713-49b2-999b-59d32fa966ef tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:11.894344 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c3fbe8fa-0713-49b2-999b-59d32fa966ef tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed" status: 200 len: 1680 microversion: 2.1 time: 0.236446 Sep 06 21:26:11.894959 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 594/1180] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:11 2022] GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed => generated 1680 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:26:12.297570 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cffbfacf-f97f-4e04-820c-b8b978adbf27 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:12.298281 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cffbfacf-f97f-4e04-820c-b8b978adbf27 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: c529da9e-51d1-43a0-8065-cf16d00ae5b3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:12.305415 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cffbfacf-f97f-4e04-820c-b8b978adbf27 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:12.305895 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cffbfacf-f97f-4e04-820c-b8b978adbf27 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:12.306343 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cffbfacf-f97f-4e04-820c-b8b978adbf27 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:12.307056 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cffbfacf-f97f-4e04-820c-b8b978adbf27 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:12.307472 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cffbfacf-f97f-4e04-820c-b8b978adbf27 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:12.307908 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cffbfacf-f97f-4e04-820c-b8b978adbf27 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:12.446199 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cffbfacf-f97f-4e04-820c-b8b978adbf27 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:12.454633 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cffbfacf-f97f-4e04-820c-b8b978adbf27 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3" status: 200 len: 1496 microversion: 2.1 time: 0.163172 Sep 06 21:26:12.455170 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 587/1181] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:12 2022] GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3 => generated 1496 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:12.918843 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c641addd-9050-4660-8924-ef5fec7ebd5d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:12.919476 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c641addd-9050-4660-8924-ef5fec7ebd5d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 17b54989-ef84-453f-920e-766847e1d0ed] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:12.926679 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c641addd-9050-4660-8924-ef5fec7ebd5d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:12.927261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c641addd-9050-4660-8924-ef5fec7ebd5d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:12.927706 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c641addd-9050-4660-8924-ef5fec7ebd5d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:12.928387 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c641addd-9050-4660-8924-ef5fec7ebd5d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:12.928872 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c641addd-9050-4660-8924-ef5fec7ebd5d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:12.929302 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c641addd-9050-4660-8924-ef5fec7ebd5d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:13.075726 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c641addd-9050-4660-8924-ef5fec7ebd5d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:13.084496 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c641addd-9050-4660-8924-ef5fec7ebd5d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed" status: 200 len: 1680 microversion: 2.1 time: 0.169739 Sep 06 21:26:13.097149 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 595/1182] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:12 2022] GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:13.127022 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4e998124-6640-4937-8b97-03b72fc602c4 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:13.127518 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4e998124-6640-4937-8b97-03b72fc602c4 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: c529da9e-51d1-43a0-8065-cf16d00ae5b3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:13.133769 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e998124-6640-4937-8b97-03b72fc602c4 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:13.135018 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e998124-6640-4937-8b97-03b72fc602c4 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:13.135615 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e998124-6640-4937-8b97-03b72fc602c4 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:13.136487 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e998124-6640-4937-8b97-03b72fc602c4 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:13.137126 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e998124-6640-4937-8b97-03b72fc602c4 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:13.137703 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e998124-6640-4937-8b97-03b72fc602c4 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:13.164128 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4e998124-6640-4937-8b97-03b72fc602c4 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: c529da9e-51d1-43a0-8065-cf16d00ae5b3] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 21:26:13.248606 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4e998124-6640-4937-8b97-03b72fc602c4 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3" status: 204 len: 0 microversion: 2.1 time: 0.125228 Sep 06 21:26:13.249239 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 588/1183] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Sep 6 21:26:13 2022] DELETE /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 21:26:13.257805 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4e4fc5e7-558e-4b66-8480-3a8c854d3e58 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:13.258471 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4e4fc5e7-558e-4b66-8480-3a8c854d3e58 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: c529da9e-51d1-43a0-8065-cf16d00ae5b3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:13.264751 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e4fc5e7-558e-4b66-8480-3a8c854d3e58 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:13.265238 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e4fc5e7-558e-4b66-8480-3a8c854d3e58 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:13.265675 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e4fc5e7-558e-4b66-8480-3a8c854d3e58 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:13.266371 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e4fc5e7-558e-4b66-8480-3a8c854d3e58 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:13.266821 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e4fc5e7-558e-4b66-8480-3a8c854d3e58 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:13.267243 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e4fc5e7-558e-4b66-8480-3a8c854d3e58 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:13.428050 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4e4fc5e7-558e-4b66-8480-3a8c854d3e58 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:13.436442 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4e4fc5e7-558e-4b66-8480-3a8c854d3e58 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3" status: 200 len: 1502 microversion: 2.1 time: 0.182792 Sep 06 21:26:13.437074 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 596/1184] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:13 2022] GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3 => generated 1502 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:14.113303 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-145acb3c-c32e-46b7-86fa-17dfc5ac52e4 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:14.113982 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-145acb3c-c32e-46b7-86fa-17dfc5ac52e4 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 17b54989-ef84-453f-920e-766847e1d0ed] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:14.120803 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-145acb3c-c32e-46b7-86fa-17dfc5ac52e4 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:14.121286 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-145acb3c-c32e-46b7-86fa-17dfc5ac52e4 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:14.121709 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-145acb3c-c32e-46b7-86fa-17dfc5ac52e4 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:14.122403 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-145acb3c-c32e-46b7-86fa-17dfc5ac52e4 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:14.122843 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-145acb3c-c32e-46b7-86fa-17dfc5ac52e4 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:14.123260 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-145acb3c-c32e-46b7-86fa-17dfc5ac52e4 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:14.276609 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-145acb3c-c32e-46b7-86fa-17dfc5ac52e4 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:14.286129 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-145acb3c-c32e-46b7-86fa-17dfc5ac52e4 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed" status: 200 len: 1680 microversion: 2.1 time: 0.179393 Sep 06 21:26:14.287037 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 589/1185] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:14 2022] GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:14.459585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2ed330d9-d4f6-44c2-b0d6-f37ea6dd65ea tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:14.460182 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2ed330d9-d4f6-44c2-b0d6-f37ea6dd65ea tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: c529da9e-51d1-43a0-8065-cf16d00ae5b3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:14.468634 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ed330d9-d4f6-44c2-b0d6-f37ea6dd65ea tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:14.469159 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ed330d9-d4f6-44c2-b0d6-f37ea6dd65ea tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:14.469585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ed330d9-d4f6-44c2-b0d6-f37ea6dd65ea tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:14.470302 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ed330d9-d4f6-44c2-b0d6-f37ea6dd65ea tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:14.470753 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ed330d9-d4f6-44c2-b0d6-f37ea6dd65ea tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:14.471172 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ed330d9-d4f6-44c2-b0d6-f37ea6dd65ea tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:14.621335 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2ed330d9-d4f6-44c2-b0d6-f37ea6dd65ea tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:14.630315 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2ed330d9-d4f6-44c2-b0d6-f37ea6dd65ea tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3" status: 200 len: 1502 microversion: 2.1 time: 0.174633 Sep 06 21:26:14.630933 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 597/1186] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:14 2022] GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3 => generated 1502 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:15.315923 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-61b15107-3429-4d74-aa51-b2e6a66a66d9 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:15.316865 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-61b15107-3429-4d74-aa51-b2e6a66a66d9 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 17b54989-ef84-453f-920e-766847e1d0ed] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:15.323707 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61b15107-3429-4d74-aa51-b2e6a66a66d9 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:15.324193 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61b15107-3429-4d74-aa51-b2e6a66a66d9 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:15.324622 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61b15107-3429-4d74-aa51-b2e6a66a66d9 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:15.325365 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61b15107-3429-4d74-aa51-b2e6a66a66d9 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:15.325814 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61b15107-3429-4d74-aa51-b2e6a66a66d9 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:15.326237 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61b15107-3429-4d74-aa51-b2e6a66a66d9 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:15.499168 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-61b15107-3429-4d74-aa51-b2e6a66a66d9 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:15.507431 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-61b15107-3429-4d74-aa51-b2e6a66a66d9 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed" status: 200 len: 1680 microversion: 2.1 time: 0.196509 Sep 06 21:26:15.507996 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 590/1187] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:15 2022] GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed => generated 1680 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:15.657390 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b93f859b-ec3e-4521-a04d-4ecd7c520be1 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:15.658435 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b93f859b-ec3e-4521-a04d-4ecd7c520be1 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: c529da9e-51d1-43a0-8065-cf16d00ae5b3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:15.668493 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b93f859b-ec3e-4521-a04d-4ecd7c520be1 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:15.669096 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b93f859b-ec3e-4521-a04d-4ecd7c520be1 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:15.669719 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b93f859b-ec3e-4521-a04d-4ecd7c520be1 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:15.670699 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b93f859b-ec3e-4521-a04d-4ecd7c520be1 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:15.671235 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b93f859b-ec3e-4521-a04d-4ecd7c520be1 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:15.671736 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b93f859b-ec3e-4521-a04d-4ecd7c520be1 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:15.948644 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b93f859b-ec3e-4521-a04d-4ecd7c520be1 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:15.957226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b93f859b-ec3e-4521-a04d-4ecd7c520be1 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3" status: 200 len: 1502 microversion: 2.1 time: 0.306219 Sep 06 21:26:15.957226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 598/1188] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:15 2022] GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3 => generated 1502 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:16.275726 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a6bbb07e-ffac-4928-a681-e4eeb9f6b5a7 req-9bb59a9e-b079-4aba-a5c8-80c414fff331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c529da9e-51d1-43a0-8065-cf16d00ae5b3", "name": "network-vif-deleted", "tag": "631fc78f-f97c-4d80-92b4-99246dc669ca"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:26:16.285886 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a6bbb07e-ffac-4928-a681-e4eeb9f6b5a7 req-9bb59a9e-b079-4aba-a5c8-80c414fff331 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:16.286357 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a6bbb07e-ffac-4928-a681-e4eeb9f6b5a7 req-9bb59a9e-b079-4aba-a5c8-80c414fff331 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:16.286776 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a6bbb07e-ffac-4928-a681-e4eeb9f6b5a7 req-9bb59a9e-b079-4aba-a5c8-80c414fff331 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:16.301464 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a6bbb07e-ffac-4928-a681-e4eeb9f6b5a7 req-9bb59a9e-b079-4aba-a5c8-80c414fff331 service nova] Creating event network-vif-deleted:631fc78f-f97c-4d80-92b4-99246dc669ca for instance c529da9e-51d1-43a0-8065-cf16d00ae5b3 on hv-cinder-74915 Sep 06 21:26:16.306645 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a6bbb07e-ffac-4928-a681-e4eeb9f6b5a7 req-9bb59a9e-b079-4aba-a5c8-80c414fff331 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035292 Sep 06 21:26:16.307327 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 591/1189] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:26:16.533220 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aa1f83db-ef4d-48b4-b319-661e90e50392 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:16.533921 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-aa1f83db-ef4d-48b4-b319-661e90e50392 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 17b54989-ef84-453f-920e-766847e1d0ed] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:16.545761 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa1f83db-ef4d-48b4-b319-661e90e50392 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:16.546593 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa1f83db-ef4d-48b4-b319-661e90e50392 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:16.547044 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa1f83db-ef4d-48b4-b319-661e90e50392 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:16.551314 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa1f83db-ef4d-48b4-b319-661e90e50392 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:16.552018 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa1f83db-ef4d-48b4-b319-661e90e50392 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:16.552466 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa1f83db-ef4d-48b4-b319-661e90e50392 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:16.673775 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-aa1f83db-ef4d-48b4-b319-661e90e50392 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:16.687161 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-aa1f83db-ef4d-48b4-b319-661e90e50392 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed" status: 200 len: 1325 microversion: 2.1 time: 0.159757 Sep 06 21:26:16.688797 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 592/1190] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:16 2022] GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed => generated 1325 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:16.710812 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-b2e748ce-412a-438b-bdf0-c72320f09dc4 req-ed21a785-dbd8-47db-89d4-39709380c17c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17b54989-ef84-453f-920e-766847e1d0ed", "name": "network-vif-deleted", "tag": "e61442a6-0816-47d9-9fea-4de0c787313b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:26:16.730318 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b2e748ce-412a-438b-bdf0-c72320f09dc4 req-ed21a785-dbd8-47db-89d4-39709380c17c service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:16.730800 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b2e748ce-412a-438b-bdf0-c72320f09dc4 req-ed21a785-dbd8-47db-89d4-39709380c17c service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:16.731230 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b2e748ce-412a-438b-bdf0-c72320f09dc4 req-ed21a785-dbd8-47db-89d4-39709380c17c service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:16.743828 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-b2e748ce-412a-438b-bdf0-c72320f09dc4 req-ed21a785-dbd8-47db-89d4-39709380c17c service nova] Creating event network-vif-deleted:e61442a6-0816-47d9-9fea-4de0c787313b for instance 17b54989-ef84-453f-920e-766847e1d0ed on hv-cinder-74915 Sep 06 21:26:16.749851 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-b2e748ce-412a-438b-bdf0-c72320f09dc4 req-ed21a785-dbd8-47db-89d4-39709380c17c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.245528 Sep 06 21:26:16.750807 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 599/1191] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:26:16.985384 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ad05015c-a7db-4529-acfb-508b45060628 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:16.988239 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ad05015c-a7db-4529-acfb-508b45060628 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: c529da9e-51d1-43a0-8065-cf16d00ae5b3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:16.995681 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad05015c-a7db-4529-acfb-508b45060628 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:16.996153 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad05015c-a7db-4529-acfb-508b45060628 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:16.996573 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad05015c-a7db-4529-acfb-508b45060628 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:16.997491 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad05015c-a7db-4529-acfb-508b45060628 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:16.997952 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad05015c-a7db-4529-acfb-508b45060628 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:16.998352 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad05015c-a7db-4529-acfb-508b45060628 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:17.041120 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad05015c-a7db-4529-acfb-508b45060628 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:17.041120 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad05015c-a7db-4529-acfb-508b45060628 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:17.041426 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad05015c-a7db-4529-acfb-508b45060628 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:17.041820 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-ad05015c-a7db-4529-acfb-508b45060628 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lazy-loading 'fault' on Instance uuid c529da9e-51d1-43a0-8065-cf16d00ae5b3 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:26:17.090929 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ad05015c-a7db-4529-acfb-508b45060628 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525ba710ef8b40d0abb27bb2cad1095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3a88bdee6e4566987b3e87b4627ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:17.099427 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ad05015c-a7db-4529-acfb-508b45060628 tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3" status: 200 len: 1303 microversion: 2.1 time: 0.120945 Sep 06 21:26:17.100032 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 593/1192] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:16 2022] GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3 => generated 1303 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:17.712894 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f1899736-1da5-40c9-9857-0c89c4dccd8f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:17.714244 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f1899736-1da5-40c9-9857-0c89c4dccd8f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 17b54989-ef84-453f-920e-766847e1d0ed] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:17.721171 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1899736-1da5-40c9-9857-0c89c4dccd8f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:17.721657 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1899736-1da5-40c9-9857-0c89c4dccd8f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:17.722094 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1899736-1da5-40c9-9857-0c89c4dccd8f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:17.722805 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1899736-1da5-40c9-9857-0c89c4dccd8f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:17.723265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1899736-1da5-40c9-9857-0c89c4dccd8f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:17.723688 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f1899736-1da5-40c9-9857-0c89c4dccd8f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:17.740247 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-f1899736-1da5-40c9-9857-0c89c4dccd8f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] HTTP exception thrown: Instance 17b54989-ef84-453f-920e-766847e1d0ed could not be found. Sep 06 21:26:17.742125 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f1899736-1da5-40c9-9857-0c89c4dccd8f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Request method failure captured: Sep 06 21:26:17.742125 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed HTTP/1.1 Sep 06 21:26:17.742125 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:26:17.742125 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:26:17.742125 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:26:17.742125 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:26:17.742125 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:26:17.742125 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:26:17.742125 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:26:17.742125 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:26:17.742125 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7oBRUaWFmUaRMRrY2lmG27XTCe8m7oOenu15JckXMhNFYDIb6s6CTPHxEIINys886U3nqIXNvhOhvtXDn-W2TtU1LkNmSf6teGC7l2Pr1U-HL4_5PeX8X3jMoeu0l-wC_3RYNggU9GitVP5pFTsCQ7cQZQ9cQw1uf_6XEJXvRawCjA Sep 06 21:26:17.742125 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:26:17.742125 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:26:17.742125 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:26:17.742125 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:26:17.742125 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:26:17.742125 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:26:17.742125 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: 0ca0b63bd9224370b45e7cc5e9c68a27 Sep 06 21:26:17.742125 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:26:17.742125 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:26:17.742125 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:26:17.743774 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0ca0b63bd9224370b45e7cc5e9c68a27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0ca0b63bd9224370b45e7cc5e9c68a27", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ca0b63bd9224370b45e7cc5e9c68a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ca0b63bd9224370b45e7cc5e9c68a27"}]}] Sep 06 21:26:17.743774 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:26:17.743774 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 0ca0b63bd9224370b45e7cc5e9c68a27 Sep 06 21:26:17.743774 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:26:17.743774 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeNegativeTest-1682827976-project Sep 06 21:26:17.743774 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:26:17.743774 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:26:17.743774 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: e22472efcb9a454688744457cb45eabb Sep 06 21:26:17.743774 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeNegativeTest-1682827976-project Sep 06 21:26:17.743774 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: > Sep 06 21:26:17.743774 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Instance 17b54989-ef84-453f-920e-766847e1d0ed could not be found. Sep 06 21:26:17.743774 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'id': '17b54989-ef84-453f-920e-766847e1d0ed'} Sep 06 21:26:17.744631 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:26:17.744631 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:26:17.744631 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:26:17.744631 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:26:17.744631 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:26:17.744631 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:26:17.744631 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:26:17.744631 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:26:17.744631 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:26:17.744631 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:26:17.744631 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17b54989-ef84-453f-920e-766847e1d0ed could not be found. Sep 06 21:26:17.744631 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:26:17.744631 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:26:17.744631 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:26:17.744631 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:26:17.744631 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:26:17.744631 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:26:17.744631 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:26:17.744631 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:26:17.744631 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:26:17.745939 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:26:17.745939 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:26:17.745939 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:26:17.745939 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:26:17.745939 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:26:17.745939 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:26:17.745939 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:26:17.745939 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17b54989-ef84-453f-920e-766847e1d0ed could not be found. Sep 06 21:26:17.745939 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:26:17.745939 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:26:17.745939 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:26:17.745939 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:26:17.745939 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:26:17.745939 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:26:17.745939 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:26:17.745939 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:26:17.745939 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17b54989-ef84-453f-920e-766847e1d0ed could not be found. Sep 06 21:26:17.745939 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:26:17.747350 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f1899736-1da5-40c9-9857-0c89c4dccd8f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Returning 404 to user: Instance 17b54989-ef84-453f-920e-766847e1d0ed could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:26:17.747350 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f1899736-1da5-40c9-9857-0c89c4dccd8f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed" status: 404 len: 111 microversion: 2.1 time: 0.037010 Sep 06 21:26:17.747350 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 600/1193] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:17 2022] GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:26:17.754603 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fe75ae67-f654-40e4-bef9-fd3776461a3a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '.version_select at 0x7f04cfc25d30>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:17.781142 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fe75ae67-f654-40e4-bef9-fd3776461a3a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-144612602" status: 202 len: 0 microversion: 2.1 time: 0.030539 Sep 06 21:26:17.781781 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 594/1194] 10.222.0.79 () {58 vars in 1218 bytes} [Tue Sep 6 21:26:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-144612602 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:26:18.123552 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ac868f1c-a992-4c16-a538-e7758606ca2b tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:18.124164 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ac868f1c-a992-4c16-a538-e7758606ca2b tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] [instance: c529da9e-51d1-43a0-8065-cf16d00ae5b3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:18.131197 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac868f1c-a992-4c16-a538-e7758606ca2b tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:18.131792 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac868f1c-a992-4c16-a538-e7758606ca2b tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:18.132237 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac868f1c-a992-4c16-a538-e7758606ca2b tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:18.135847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac868f1c-a992-4c16-a538-e7758606ca2b tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:18.135847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac868f1c-a992-4c16-a538-e7758606ca2b tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:18.135847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ac868f1c-a992-4c16-a538-e7758606ca2b tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:18.150024 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-ac868f1c-a992-4c16-a538-e7758606ca2b tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] HTTP exception thrown: Instance c529da9e-51d1-43a0-8065-cf16d00ae5b3 could not be found. Sep 06 21:26:18.151623 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ac868f1c-a992-4c16-a538-e7758606ca2b tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Request method failure captured: Sep 06 21:26:18.151623 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3 HTTP/1.1 Sep 06 21:26:18.151623 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:26:18.151623 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:26:18.151623 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:26:18.151623 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:26:18.151623 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:26:18.151623 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:26:18.151623 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:26:18.151623 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:26:18.151623 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7rSab5-cUkdP02aMO3KU6b2E2usoN2BQVa4y-_qbnhvnsTS7xmT4x7Cexuin6jio5qi-LAjbSgbTgexw-cwAWKWqqOS8Lc4u3gFIV9HbbDQm33boEg3LvP-LakOLAYD2xJAksDediRGeX-Ugrp4y-O4jImuPfpc_VNrei6WcTQlrcA Sep 06 21:26:18.151623 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:26:18.151623 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:26:18.151623 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:26:18.151623 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:26:18.151623 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:26:18.151623 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:26:18.151623 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: 8c3a88bdee6e4566987b3e87b4627ca6 Sep 06 21:26:18.151623 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesActionsTest-850348177 Sep 06 21:26:18.151623 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:26:18.151623 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:26:18.153189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8c3a88bdee6e4566987b3e87b4627ca6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8c3a88bdee6e4566987b3e87b4627ca6", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c3a88bdee6e4566987b3e87b4627ca6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c3a88bdee6e4566987b3e87b4627ca6"}]}] Sep 06 21:26:18.153189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-VolumesActionsTest-850348177 Sep 06 21:26:18.153189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 8c3a88bdee6e4566987b3e87b4627ca6 Sep 06 21:26:18.153189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesActionsTest-850348177 Sep 06 21:26:18.153189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-VolumesActionsTest-850348177-project Sep 06 21:26:18.153189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:26:18.153189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:26:18.153189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: 525ba710ef8b40d0abb27bb2cad1095c Sep 06 21:26:18.153189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-VolumesActionsTest-850348177-project Sep 06 21:26:18.153189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: > Sep 06 21:26:18.153189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Instance c529da9e-51d1-43a0-8065-cf16d00ae5b3 could not be found. Sep 06 21:26:18.153189 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'id': 'c529da9e-51d1-43a0-8065-cf16d00ae5b3'} Sep 06 21:26:18.159169 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:26:18.159169 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:26:18.159169 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:26:18.159169 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:26:18.159169 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:26:18.159169 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:26:18.159169 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:26:18.159169 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:26:18.159169 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:26:18.159169 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:26:18.159169 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c529da9e-51d1-43a0-8065-cf16d00ae5b3 could not be found. Sep 06 21:26:18.159169 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:26:18.159169 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:26:18.159169 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:26:18.159169 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:26:18.159169 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:26:18.159169 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:26:18.159169 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:26:18.159169 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:26:18.159169 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:26:18.160858 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:26:18.160858 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:26:18.160858 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:26:18.160858 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:26:18.160858 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:26:18.160858 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:26:18.160858 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:26:18.160858 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c529da9e-51d1-43a0-8065-cf16d00ae5b3 could not be found. Sep 06 21:26:18.160858 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:26:18.160858 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:26:18.160858 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:26:18.160858 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:26:18.160858 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:26:18.160858 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:26:18.160858 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:26:18.160858 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:26:18.160858 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c529da9e-51d1-43a0-8065-cf16d00ae5b3 could not be found. Sep 06 21:26:18.160858 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:26:18.162153 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ac868f1c-a992-4c16-a538-e7758606ca2b tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] Returning 404 to user: Instance c529da9e-51d1-43a0-8065-cf16d00ae5b3 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:26:18.162153 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ac868f1c-a992-4c16-a538-e7758606ca2b tempest-VolumesActionsTest-850348177 tempest-VolumesActionsTest-850348177-project] 10.222.0.79 "GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3" status: 404 len: 111 microversion: 2.1 time: 0.033451 Sep 06 21:26:18.162153 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 601/1195] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:18 2022] GET /compute/v2.1/servers/c529da9e-51d1-43a0-8065-cf16d00ae5b3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:26:18.495222 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d46d670a-7137-468a-a111-5e568897c07f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:18.495222 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d46d670a-7137-468a-a111-5e568897c07f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:18.499983 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d46d670a-7137-468a-a111-5e568897c07f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:18.500587 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d46d670a-7137-468a-a111-5e568897c07f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:18.501072 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d46d670a-7137-468a-a111-5e568897c07f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:18.501794 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d46d670a-7137-468a-a111-5e568897c07f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:18.502234 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d46d670a-7137-468a-a111-5e568897c07f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:18.502654 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d46d670a-7137-468a-a111-5e568897c07f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:18.523947 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:26:18.601008 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-d46d670a-7137-468a-a111-5e568897c07f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lazy-loading 'services' on Instance uuid 84876df2-af4d-4824-a96b-039881a934d3 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:26:18.685377 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d46d670a-7137-468a-a111-5e568897c07f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "DELETE /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments/e1e113b7-8142-45e1-afe6-c027eca270d5" status: 202 len: 0 microversion: 2.1 time: 0.197317 Sep 06 21:26:18.686300 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 595/1196] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Sep 6 21:26:18 2022] DELETE /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments/e1e113b7-8142-45e1-afe6-c027eca270d5 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:26:18.695801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-24af4b8e-07df-46d8-979c-977c053b402e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:18.698332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-24af4b8e-07df-46d8-979c-977c053b402e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:18.706063 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24af4b8e-07df-46d8-979c-977c053b402e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:18.707000 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24af4b8e-07df-46d8-979c-977c053b402e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:18.707589 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24af4b8e-07df-46d8-979c-977c053b402e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:18.708415 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24af4b8e-07df-46d8-979c-977c053b402e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:18.708934 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24af4b8e-07df-46d8-979c-977c053b402e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:18.709382 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24af4b8e-07df-46d8-979c-977c053b402e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:18.751783 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-24af4b8e-07df-46d8-979c-977c053b402e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060951 Sep 06 21:26:18.752338 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 602/1197] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:26:18 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:26:19.768479 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d77755a1-0ecf-4747-a054-68040076d97a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:19.771037 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d77755a1-0ecf-4747-a054-68040076d97a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:19.779846 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d77755a1-0ecf-4747-a054-68040076d97a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:19.780334 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d77755a1-0ecf-4747-a054-68040076d97a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:19.780802 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d77755a1-0ecf-4747-a054-68040076d97a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:19.781527 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d77755a1-0ecf-4747-a054-68040076d97a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:19.781975 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d77755a1-0ecf-4747-a054-68040076d97a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:19.782443 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d77755a1-0ecf-4747-a054-68040076d97a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:19.817977 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d77755a1-0ecf-4747-a054-68040076d97a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055567 Sep 06 21:26:19.818611 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 596/1198] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:26:19 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 21:26:20.831835 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7eca8b11-9b87-45c8-b2d7-00a9bf30630f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:20.834088 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7eca8b11-9b87-45c8-b2d7-00a9bf30630f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:20.841235 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7eca8b11-9b87-45c8-b2d7-00a9bf30630f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:20.841788 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7eca8b11-9b87-45c8-b2d7-00a9bf30630f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:20.842143 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7eca8b11-9b87-45c8-b2d7-00a9bf30630f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:20.842857 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7eca8b11-9b87-45c8-b2d7-00a9bf30630f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:20.843307 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7eca8b11-9b87-45c8-b2d7-00a9bf30630f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:20.843782 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7eca8b11-9b87-45c8-b2d7-00a9bf30630f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:20.875402 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7eca8b11-9b87-45c8-b2d7-00a9bf30630f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047932 Sep 06 21:26:20.875975 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 603/1199] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:26:20 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:26:21.888682 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cf87004e-8434-41b9-a03c-d3198df582d5 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:21.890855 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cf87004e-8434-41b9-a03c-d3198df582d5 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:21.899480 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf87004e-8434-41b9-a03c-d3198df582d5 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:21.899967 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf87004e-8434-41b9-a03c-d3198df582d5 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:21.900401 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf87004e-8434-41b9-a03c-d3198df582d5 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:21.901146 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf87004e-8434-41b9-a03c-d3198df582d5 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:21.901595 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf87004e-8434-41b9-a03c-d3198df582d5 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:21.902022 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf87004e-8434-41b9-a03c-d3198df582d5 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:21.934295 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cf87004e-8434-41b9-a03c-d3198df582d5 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049862 Sep 06 21:26:21.934856 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 597/1200] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:26:21 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:26:22.951353 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b5ae70cf-e39a-4601-98e4-3cd3df21fd74 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:22.954859 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b5ae70cf-e39a-4601-98e4-3cd3df21fd74 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:22.965995 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5ae70cf-e39a-4601-98e4-3cd3df21fd74 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:22.966770 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5ae70cf-e39a-4601-98e4-3cd3df21fd74 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:22.967420 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5ae70cf-e39a-4601-98e4-3cd3df21fd74 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:22.968570 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5ae70cf-e39a-4601-98e4-3cd3df21fd74 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:22.969346 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5ae70cf-e39a-4601-98e4-3cd3df21fd74 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:22.970029 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5ae70cf-e39a-4601-98e4-3cd3df21fd74 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:23.002761 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b5ae70cf-e39a-4601-98e4-3cd3df21fd74 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058282 Sep 06 21:26:23.003338 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 604/1201] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:26:22 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:26:24.015766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-83d7bacb-964b-4e86-906d-1f54902a0be6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:24.018020 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-83d7bacb-964b-4e86-906d-1f54902a0be6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:24.026095 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83d7bacb-964b-4e86-906d-1f54902a0be6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:24.026575 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83d7bacb-964b-4e86-906d-1f54902a0be6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:24.027011 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83d7bacb-964b-4e86-906d-1f54902a0be6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:24.027701 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83d7bacb-964b-4e86-906d-1f54902a0be6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:24.028153 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83d7bacb-964b-4e86-906d-1f54902a0be6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:24.028575 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83d7bacb-964b-4e86-906d-1f54902a0be6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:24.062127 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-83d7bacb-964b-4e86-906d-1f54902a0be6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050395 Sep 06 21:26:24.062677 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 598/1202] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:26:24 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:26:25.079131 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b7b8a391-a8a4-4bd3-8697-1dee3c94be64 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:25.082803 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b7b8a391-a8a4-4bd3-8697-1dee3c94be64 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:25.094025 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7b8a391-a8a4-4bd3-8697-1dee3c94be64 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:25.094532 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7b8a391-a8a4-4bd3-8697-1dee3c94be64 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:25.095256 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7b8a391-a8a4-4bd3-8697-1dee3c94be64 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:25.096413 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7b8a391-a8a4-4bd3-8697-1dee3c94be64 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:25.097377 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7b8a391-a8a4-4bd3-8697-1dee3c94be64 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:25.098117 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7b8a391-a8a4-4bd3-8697-1dee3c94be64 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:25.132783 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b7b8a391-a8a4-4bd3-8697-1dee3c94be64 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060226 Sep 06 21:26:25.133357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 605/1203] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:26:25 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:26:26.146019 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-71736def-08e3-4786-a335-acd117aebf9d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:26.148348 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-71736def-08e3-4786-a335-acd117aebf9d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:26.155727 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71736def-08e3-4786-a335-acd117aebf9d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:26.156236 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71736def-08e3-4786-a335-acd117aebf9d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:26.156649 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71736def-08e3-4786-a335-acd117aebf9d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:26.157382 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71736def-08e3-4786-a335-acd117aebf9d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:26.157830 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71736def-08e3-4786-a335-acd117aebf9d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:26.158250 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71736def-08e3-4786-a335-acd117aebf9d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:26.189725 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-71736def-08e3-4786-a335-acd117aebf9d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047915 Sep 06 21:26:26.190418 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 599/1204] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:26:26 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:26:27.207198 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-59642e43-1e79-47c8-8830-1deec70b34df tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:27.210608 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-59642e43-1e79-47c8-8830-1deec70b34df tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:27.221900 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59642e43-1e79-47c8-8830-1deec70b34df tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:27.222689 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59642e43-1e79-47c8-8830-1deec70b34df tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:27.223394 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59642e43-1e79-47c8-8830-1deec70b34df tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:27.227563 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59642e43-1e79-47c8-8830-1deec70b34df tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:27.227563 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59642e43-1e79-47c8-8830-1deec70b34df tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:27.227563 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59642e43-1e79-47c8-8830-1deec70b34df tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:27.257271 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-59642e43-1e79-47c8-8830-1deec70b34df tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056995 Sep 06 21:26:27.257980 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 606/1205] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:26:27 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:26:28.271025 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e8b4b677-4390-4255-876b-2c54ea342003 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:28.275487 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e8b4b677-4390-4255-876b-2c54ea342003 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:28.283316 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8b4b677-4390-4255-876b-2c54ea342003 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:28.283807 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8b4b677-4390-4255-876b-2c54ea342003 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:28.284277 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8b4b677-4390-4255-876b-2c54ea342003 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:28.285026 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8b4b677-4390-4255-876b-2c54ea342003 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:28.285474 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8b4b677-4390-4255-876b-2c54ea342003 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:28.285927 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8b4b677-4390-4255-876b-2c54ea342003 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:28.318602 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e8b4b677-4390-4255-876b-2c54ea342003 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052019 Sep 06 21:26:28.319363 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 600/1206] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:26:28 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:26:29.332014 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5f952689-9089-4abe-87e9-c3099c8385bf tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:29.334200 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5f952689-9089-4abe-87e9-c3099c8385bf tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:29.341786 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f952689-9089-4abe-87e9-c3099c8385bf tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:29.342365 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f952689-9089-4abe-87e9-c3099c8385bf tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:29.342909 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f952689-9089-4abe-87e9-c3099c8385bf tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:29.343611 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f952689-9089-4abe-87e9-c3099c8385bf tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:29.344069 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f952689-9089-4abe-87e9-c3099c8385bf tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:29.344493 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f952689-9089-4abe-87e9-c3099c8385bf tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:29.359564 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:26:29.376390 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5f952689-9089-4abe-87e9-c3099c8385bf tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048480 Sep 06 21:26:29.376936 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 607/1207] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:26:29 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:26:30.389218 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3fa99a74-b34b-4a3f-be81-3704d5905c0a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:30.391328 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3fa99a74-b34b-4a3f-be81-3704d5905c0a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:30.398397 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fa99a74-b34b-4a3f-be81-3704d5905c0a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:30.398894 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fa99a74-b34b-4a3f-be81-3704d5905c0a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:30.399327 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fa99a74-b34b-4a3f-be81-3704d5905c0a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:30.400045 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fa99a74-b34b-4a3f-be81-3704d5905c0a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:30.400540 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fa99a74-b34b-4a3f-be81-3704d5905c0a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:30.400996 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fa99a74-b34b-4a3f-be81-3704d5905c0a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:30.439281 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3fa99a74-b34b-4a3f-be81-3704d5905c0a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054232 Sep 06 21:26:30.439830 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 601/1208] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:26:30 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:26:31.453246 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-43d4d07f-6ac0-43c5-b1fa-ab1ea1e4003b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:31.455361 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-43d4d07f-6ac0-43c5-b1fa-ab1ea1e4003b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:31.462146 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43d4d07f-6ac0-43c5-b1fa-ab1ea1e4003b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:31.462658 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43d4d07f-6ac0-43c5-b1fa-ab1ea1e4003b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:31.463090 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43d4d07f-6ac0-43c5-b1fa-ab1ea1e4003b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:31.463797 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43d4d07f-6ac0-43c5-b1fa-ab1ea1e4003b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:31.464244 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43d4d07f-6ac0-43c5-b1fa-ab1ea1e4003b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:31.464697 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43d4d07f-6ac0-43c5-b1fa-ab1ea1e4003b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:31.500558 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-43d4d07f-6ac0-43c5-b1fa-ab1ea1e4003b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052143 Sep 06 21:26:31.501201 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 608/1209] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:26:31 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:26:32.513893 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-af0fd84e-daaf-4b97-a0d1-e89a039f9647 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:32.516175 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-af0fd84e-daaf-4b97-a0d1-e89a039f9647 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:32.523246 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af0fd84e-daaf-4b97-a0d1-e89a039f9647 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:32.524998 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af0fd84e-daaf-4b97-a0d1-e89a039f9647 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:32.525649 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af0fd84e-daaf-4b97-a0d1-e89a039f9647 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:32.527045 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af0fd84e-daaf-4b97-a0d1-e89a039f9647 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:32.527672 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af0fd84e-daaf-4b97-a0d1-e89a039f9647 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:32.528265 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af0fd84e-daaf-4b97-a0d1-e89a039f9647 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:32.562993 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-af0fd84e-daaf-4b97-a0d1-e89a039f9647 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053566 Sep 06 21:26:32.563802 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 602/1210] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:26:32 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:26:33.579856 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7298ca1b-a399-4f51-92bb-c050651a301c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:33.583237 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7298ca1b-a399-4f51-92bb-c050651a301c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:33.588177 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=42 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:26:33.593131 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7298ca1b-a399-4f51-92bb-c050651a301c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:33.593617 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7298ca1b-a399-4f51-92bb-c050651a301c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:33.594052 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7298ca1b-a399-4f51-92bb-c050651a301c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:33.594764 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7298ca1b-a399-4f51-92bb-c050651a301c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:33.595215 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7298ca1b-a399-4f51-92bb-c050651a301c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:33.595630 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7298ca1b-a399-4f51-92bb-c050651a301c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:33.626613 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7298ca1b-a399-4f51-92bb-c050651a301c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053677 Sep 06 21:26:33.627170 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 609/1211] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:26:33 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:26:34.639455 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d615c476-f105-4a48-aeb9-b47d7c3e18c1 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:34.642621 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d615c476-f105-4a48-aeb9-b47d7c3e18c1 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:34.645152 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:26:34.650753 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d615c476-f105-4a48-aeb9-b47d7c3e18c1 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:34.651213 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d615c476-f105-4a48-aeb9-b47d7c3e18c1 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:34.651874 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d615c476-f105-4a48-aeb9-b47d7c3e18c1 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:34.652585 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d615c476-f105-4a48-aeb9-b47d7c3e18c1 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:34.653087 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d615c476-f105-4a48-aeb9-b47d7c3e18c1 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:34.653497 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d615c476-f105-4a48-aeb9-b47d7c3e18c1 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:34.701588 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d615c476-f105-4a48-aeb9-b47d7c3e18c1 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066231 Sep 06 21:26:34.702141 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 603/1212] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:26:34 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:26:35.714255 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5e9a1b4c-2596-4b8a-89b3-c2b4e4b1a472 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:35.717003 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5e9a1b4c-2596-4b8a-89b3-c2b4e4b1a472 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:35.723831 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e9a1b4c-2596-4b8a-89b3-c2b4e4b1a472 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:35.724310 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e9a1b4c-2596-4b8a-89b3-c2b4e4b1a472 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:35.724748 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e9a1b4c-2596-4b8a-89b3-c2b4e4b1a472 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:35.725441 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e9a1b4c-2596-4b8a-89b3-c2b4e4b1a472 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:35.725887 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e9a1b4c-2596-4b8a-89b3-c2b4e4b1a472 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:35.726301 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e9a1b4c-2596-4b8a-89b3-c2b4e4b1a472 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:35.757398 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5e9a1b4c-2596-4b8a-89b3-c2b4e4b1a472 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047608 Sep 06 21:26:35.758418 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 610/1213] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:26:35 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 21:26:35.832046 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cce7a702-3baa-41de-96a2-91b56efb7249 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:35.833226 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cce7a702-3baa-41de-96a2-91b56efb7249 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:35.840349 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cce7a702-3baa-41de-96a2-91b56efb7249 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:35.841217 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cce7a702-3baa-41de-96a2-91b56efb7249 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:35.841651 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cce7a702-3baa-41de-96a2-91b56efb7249 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:35.842415 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cce7a702-3baa-41de-96a2-91b56efb7249 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:35.842884 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cce7a702-3baa-41de-96a2-91b56efb7249 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:35.843335 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cce7a702-3baa-41de-96a2-91b56efb7249 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:35.872345 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cce7a702-3baa-41de-96a2-91b56efb7249 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 21:26:35.966180 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cce7a702-3baa-41de-96a2-91b56efb7249 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "DELETE /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3" status: 204 len: 0 microversion: 2.1 time: 0.137684 Sep 06 21:26:35.967226 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 604/1214] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Sep 6 21:26:35 2022] DELETE /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 21:26:35.976592 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-764a391d-3f20-4cbd-892f-42841a7b7ddd tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:35.977226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-764a391d-3f20-4cbd-892f-42841a7b7ddd tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:35.986438 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-764a391d-3f20-4cbd-892f-42841a7b7ddd tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:35.986917 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-764a391d-3f20-4cbd-892f-42841a7b7ddd tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:35.987540 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-764a391d-3f20-4cbd-892f-42841a7b7ddd tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:35.988469 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-764a391d-3f20-4cbd-892f-42841a7b7ddd tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:35.988933 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-764a391d-3f20-4cbd-892f-42841a7b7ddd tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:35.989360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-764a391d-3f20-4cbd-892f-42841a7b7ddd tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:36.134902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-764a391d-3f20-4cbd-892f-42841a7b7ddd tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:36.143340 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-764a391d-3f20-4cbd-892f-42841a7b7ddd tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3" status: 200 len: 1681 microversion: 2.1 time: 0.170913 Sep 06 21:26:36.144085 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 611/1215] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:35 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:37.169423 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-06a28d84-9a3e-4d79-8f39-b34ec04d356a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:37.170888 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-06a28d84-9a3e-4d79-8f39-b34ec04d356a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:37.178548 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06a28d84-9a3e-4d79-8f39-b34ec04d356a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:37.179025 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06a28d84-9a3e-4d79-8f39-b34ec04d356a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:37.179692 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06a28d84-9a3e-4d79-8f39-b34ec04d356a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:37.180414 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06a28d84-9a3e-4d79-8f39-b34ec04d356a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:37.180900 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06a28d84-9a3e-4d79-8f39-b34ec04d356a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:37.181307 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06a28d84-9a3e-4d79-8f39-b34ec04d356a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:37.320713 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-06a28d84-9a3e-4d79-8f39-b34ec04d356a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:37.329248 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-06a28d84-9a3e-4d79-8f39-b34ec04d356a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3" status: 200 len: 1681 microversion: 2.1 time: 0.164702 Sep 06 21:26:37.341147 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 605/1216] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:37 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:38.362560 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e1a47905-8702-4cd9-9b3d-7b697551fc25 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:38.364113 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e1a47905-8702-4cd9-9b3d-7b697551fc25 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:38.381214 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1a47905-8702-4cd9-9b3d-7b697551fc25 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:38.381836 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1a47905-8702-4cd9-9b3d-7b697551fc25 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:38.382339 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1a47905-8702-4cd9-9b3d-7b697551fc25 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:38.383274 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1a47905-8702-4cd9-9b3d-7b697551fc25 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:38.383729 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1a47905-8702-4cd9-9b3d-7b697551fc25 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:38.384147 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e1a47905-8702-4cd9-9b3d-7b697551fc25 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:38.543279 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e1a47905-8702-4cd9-9b3d-7b697551fc25 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:38.552001 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e1a47905-8702-4cd9-9b3d-7b697551fc25 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3" status: 200 len: 1681 microversion: 2.1 time: 0.201401 Sep 06 21:26:38.552608 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 612/1217] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:38 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3 => generated 1681 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:39.577874 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bb73a6aa-e231-48c6-adb5-1b687caaa98b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:39.579665 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bb73a6aa-e231-48c6-adb5-1b687caaa98b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:39.588387 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb73a6aa-e231-48c6-adb5-1b687caaa98b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:39.590137 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb73a6aa-e231-48c6-adb5-1b687caaa98b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:39.591182 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb73a6aa-e231-48c6-adb5-1b687caaa98b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:39.592204 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb73a6aa-e231-48c6-adb5-1b687caaa98b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:39.592937 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb73a6aa-e231-48c6-adb5-1b687caaa98b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:39.593622 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb73a6aa-e231-48c6-adb5-1b687caaa98b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:39.681057 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bb73a6aa-e231-48c6-adb5-1b687caaa98b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:39.691179 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bb73a6aa-e231-48c6-adb5-1b687caaa98b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3" status: 200 len: 1614 microversion: 2.1 time: 0.118441 Sep 06 21:26:39.707327 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 606/1218] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:39 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3 => generated 1614 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:40.185487 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-988094ce-901a-426d-9feb-7236f569fa06 req-113c6396-a8eb-4f7f-8d03-4f451e74cf3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84876df2-af4d-4824-a96b-039881a934d3", "name": "network-vif-deleted", "tag": "af839687-7616-4ebc-b3b9-e1aa0070a80a"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:26:40.201546 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-988094ce-901a-426d-9feb-7236f569fa06 req-113c6396-a8eb-4f7f-8d03-4f451e74cf3f service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:40.202643 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-988094ce-901a-426d-9feb-7236f569fa06 req-113c6396-a8eb-4f7f-8d03-4f451e74cf3f service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:40.203448 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-988094ce-901a-426d-9feb-7236f569fa06 req-113c6396-a8eb-4f7f-8d03-4f451e74cf3f service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:40.218810 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-988094ce-901a-426d-9feb-7236f569fa06 req-113c6396-a8eb-4f7f-8d03-4f451e74cf3f service nova] Creating event network-vif-deleted:af839687-7616-4ebc-b3b9-e1aa0070a80a for instance 84876df2-af4d-4824-a96b-039881a934d3 on hv-cinder-74915 Sep 06 21:26:40.225751 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-988094ce-901a-426d-9feb-7236f569fa06 req-113c6396-a8eb-4f7f-8d03-4f451e74cf3f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043627 Sep 06 21:26:40.234960 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 613/1219] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:26:40.717035 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-705d35d2-0c55-4837-ac84-a45c14839691 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:40.719900 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-705d35d2-0c55-4837-ac84-a45c14839691 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:40.730201 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-705d35d2-0c55-4837-ac84-a45c14839691 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:40.731005 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-705d35d2-0c55-4837-ac84-a45c14839691 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:40.731444 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-705d35d2-0c55-4837-ac84-a45c14839691 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:40.732167 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-705d35d2-0c55-4837-ac84-a45c14839691 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:40.732611 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-705d35d2-0c55-4837-ac84-a45c14839691 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:40.733225 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-705d35d2-0c55-4837-ac84-a45c14839691 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:40.776168 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-705d35d2-0c55-4837-ac84-a45c14839691 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:40.777218 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-705d35d2-0c55-4837-ac84-a45c14839691 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:40.777744 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-705d35d2-0c55-4837-ac84-a45c14839691 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:40.778380 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-705d35d2-0c55-4837-ac84-a45c14839691 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lazy-loading 'fault' on Instance uuid 84876df2-af4d-4824-a96b-039881a934d3 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:26:40.833321 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-705d35d2-0c55-4837-ac84-a45c14839691 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:40.845327 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-705d35d2-0c55-4837-ac84-a45c14839691 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3" status: 200 len: 1331 microversion: 2.1 time: 0.133837 Sep 06 21:26:40.846030 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 607/1220] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:40 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3 => generated 1331 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:41.872706 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1cfca9a5-3bd9-4389-8cd5-053658774500 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:41.873373 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1cfca9a5-3bd9-4389-8cd5-053658774500 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:41.879960 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1cfca9a5-3bd9-4389-8cd5-053658774500 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:41.880470 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1cfca9a5-3bd9-4389-8cd5-053658774500 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:41.880929 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1cfca9a5-3bd9-4389-8cd5-053658774500 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:41.881647 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1cfca9a5-3bd9-4389-8cd5-053658774500 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:41.882095 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1cfca9a5-3bd9-4389-8cd5-053658774500 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:41.882520 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1cfca9a5-3bd9-4389-8cd5-053658774500 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:41.897726 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-1cfca9a5-3bd9-4389-8cd5-053658774500 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] HTTP exception thrown: Instance 84876df2-af4d-4824-a96b-039881a934d3 could not be found. Sep 06 21:26:41.899430 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1cfca9a5-3bd9-4389-8cd5-053658774500 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Request method failure captured: Sep 06 21:26:41.899430 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3 HTTP/1.1 Sep 06 21:26:41.899430 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:26:41.899430 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:26:41.899430 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:26:41.899430 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:26:41.899430 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:26:41.899430 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:26:41.899430 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:26:41.899430 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:26:41.899430 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7oBRUaWFmUaRMRrY2lmG27XTCe8m7oOenu15JckXMhNFYDIb6s6CTPHxEIINys886U3nqIXNvhOhvtXDn-W2TtU1LkNmSf6teGC7l2Pr1U-HL4_5PeX8X3jMoeu0l-wC_3RYNggU9GitVP5pFTsCQ7cQZQ9cQw1uf_6XEJXvRawCjA Sep 06 21:26:41.899430 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:26:41.899430 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:26:41.899430 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:26:41.899430 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:26:41.899430 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:26:41.899430 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:26:41.899430 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: 0ca0b63bd9224370b45e7cc5e9c68a27 Sep 06 21:26:41.899430 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:26:41.899430 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:26:41.899430 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:26:41.901187 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0ca0b63bd9224370b45e7cc5e9c68a27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0ca0b63bd9224370b45e7cc5e9c68a27", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ca0b63bd9224370b45e7cc5e9c68a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ca0b63bd9224370b45e7cc5e9c68a27"}]}] Sep 06 21:26:41.901187 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:26:41.901187 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 0ca0b63bd9224370b45e7cc5e9c68a27 Sep 06 21:26:41.901187 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:26:41.901187 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeNegativeTest-1682827976-project Sep 06 21:26:41.901187 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:26:41.901187 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:26:41.901187 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: e22472efcb9a454688744457cb45eabb Sep 06 21:26:41.901187 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeNegativeTest-1682827976-project Sep 06 21:26:41.901187 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: > Sep 06 21:26:41.901187 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Instance 84876df2-af4d-4824-a96b-039881a934d3 could not be found. Sep 06 21:26:41.901187 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'id': '84876df2-af4d-4824-a96b-039881a934d3'} Sep 06 21:26:41.905801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:26:41.905801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:26:41.905801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:26:41.905801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:26:41.905801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:26:41.905801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:26:41.905801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:26:41.905801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:26:41.905801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:26:41.905801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:26:41.905801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84876df2-af4d-4824-a96b-039881a934d3 could not be found. Sep 06 21:26:41.905801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:26:41.905801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:26:41.905801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:26:41.905801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:26:41.905801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:26:41.905801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:26:41.905801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:26:41.905801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:26:41.905801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:26:41.907167 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:26:41.907167 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:26:41.907167 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:26:41.907167 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:26:41.907167 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:26:41.907167 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:26:41.907167 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:26:41.907167 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84876df2-af4d-4824-a96b-039881a934d3 could not be found. Sep 06 21:26:41.907167 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:26:41.907167 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:26:41.907167 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:26:41.907167 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:26:41.907167 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:26:41.907167 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:26:41.907167 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:26:41.907167 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:26:41.907167 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84876df2-af4d-4824-a96b-039881a934d3 could not be found. Sep 06 21:26:41.907167 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:26:41.908360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1cfca9a5-3bd9-4389-8cd5-053658774500 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Returning 404 to user: Instance 84876df2-af4d-4824-a96b-039881a934d3 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:26:41.908360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1cfca9a5-3bd9-4389-8cd5-053658774500 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3" status: 404 len: 111 microversion: 2.1 time: 0.034905 Sep 06 21:26:41.908360 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 614/1221] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:41 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:26:41.914424 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9ac45b63-a38c-44c3-9e95-e57c6c25ae58 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '.version_select at 0x7f04ce93eb80>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:41.940192 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9ac45b63-a38c-44c3-9e95-e57c6c25ae58 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-481579894" status: 202 len: 0 microversion: 2.1 time: 0.029568 Sep 06 21:26:41.945617 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 608/1222] 10.222.0.79 () {58 vars in 1218 bytes} [Tue Sep 6 21:26:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-481579894 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:26:42.714734 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8ea51c52-aa10-4a1e-ad89-78661ab952bf tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Action: 'create', calling method: .version_select at 0x7f04ce5f4700>, body: {"keypair": {"name": "tempest-keypair-108857745", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdZCK3+84VzRcsnVyXbCo3t0s/SANg4TaPevhXq3VW5xYWXRXqujOMCpapQz7/6nmcK/yMQbrHCkgshMNjmi5nTzLE7AXNy1Pw2EgM0e2AGUSAJrfplxUCJIWkYGYrHmw=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:26:42.732406 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-8ea51c52-aa10-4a1e-ad89-78661ab952bf tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Getting quotas for project 0ca0b63bd9224370b45e7cc5e9c68a27. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:26:42.738833 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-8ea51c52-aa10-4a1e-ad89-78661ab952bf tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Getting quotas for user e22472efcb9a454688744457cb45eabb and project 0ca0b63bd9224370b45e7cc5e9c68a27. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:26:42.765302 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8ea51c52-aa10-4a1e-ad89-78661ab952bf tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057478 Sep 06 21:26:42.766648 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 615/1223] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Sep 6 21:26:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:26:44.295018 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-51d99e55-e310-44ca-9eb0-5a7e440b0f5c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-534705024", "imageRef": "8b4a7612-517c-4711-8637-36b221338f65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1fbc3f3e-7fe7-459b-8f2b-1c8b1d601e7b"}], "security_groups": [{"name": "tempest-securitygroup--239309325"}], "key_name": "tempest-keypair-108857745", "user_data": "}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:26:44.420541 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-51d99e55-e310-44ca-9eb0-5a7e440b0f5c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] validate_networks() for [('1fbc3f3e-7fe7-459b-8f2b-1c8b1d601e7b', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 21:26:44.973879 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-51d99e55-e310-44ca-9eb0-5a7e440b0f5c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 21:26:44.974675 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-51d99e55-e310-44ca-9eb0-5a7e440b0f5c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 21:26:44.975669 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-51d99e55-e310-44ca-9eb0-5a7e440b0f5c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 21:26:44.976522 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-51d99e55-e310-44ca-9eb0-5a7e440b0f5c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 21:26:44.977244 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-51d99e55-e310-44ca-9eb0-5a7e440b0f5c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 21:26:44.997076 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51d99e55-e310-44ca-9eb0-5a7e440b0f5c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:44.998567 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51d99e55-e310-44ca-9eb0-5a7e440b0f5c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:44.999407 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51d99e55-e310-44ca-9eb0-5a7e440b0f5c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:45.000155 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51d99e55-e310-44ca-9eb0-5a7e440b0f5c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:45.001148 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51d99e55-e310-44ca-9eb0-5a7e440b0f5c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:45.001965 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51d99e55-e310-44ca-9eb0-5a7e440b0f5c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:45.024547 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-51d99e55-e310-44ca-9eb0-5a7e440b0f5c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Getting quotas for project 0ca0b63bd9224370b45e7cc5e9c68a27. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:26:45.029110 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-51d99e55-e310-44ca-9eb0-5a7e440b0f5c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Getting quotas for user e22472efcb9a454688744457cb45eabb and project 0ca0b63bd9224370b45e7cc5e9c68a27. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:26:45.042035 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-51d99e55-e310-44ca-9eb0-5a7e440b0f5c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 21:26:45.044534 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-51d99e55-e310-44ca-9eb0-5a7e440b0f5c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8b4a7612-517c-4711-8637-36b221338f65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 21:26:45.097069 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-51d99e55-e310-44ca-9eb0-5a7e440b0f5c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.807120 Sep 06 21:26:45.098223 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 609/1224] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Sep 6 21:26:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 21:26:45.110711 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0f7fbdd2-59c1-4720-a73c-1a7af60c3cc7 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:45.111529 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0f7fbdd2-59c1-4720-a73c-1a7af60c3cc7 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:45.180843 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0f7fbdd2-59c1-4720-a73c-1a7af60c3cc7 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:45.194301 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0f7fbdd2-59c1-4720-a73c-1a7af60c3cc7 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a" status: 200 len: 1240 microversion: 2.1 time: 0.088640 Sep 06 21:26:45.196390 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 616/1225] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:45 2022] GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a => generated 1240 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:46.222025 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b0c208c3-c49b-45cd-bce8-b3ee6b18a204 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:46.222758 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b0c208c3-c49b-45cd-bce8-b3ee6b18a204 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:46.229827 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0c208c3-c49b-45cd-bce8-b3ee6b18a204 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:46.230359 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0c208c3-c49b-45cd-bce8-b3ee6b18a204 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:46.230749 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0c208c3-c49b-45cd-bce8-b3ee6b18a204 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:46.231485 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0c208c3-c49b-45cd-bce8-b3ee6b18a204 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:46.231938 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0c208c3-c49b-45cd-bce8-b3ee6b18a204 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:46.232355 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0c208c3-c49b-45cd-bce8-b3ee6b18a204 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:46.322492 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b0c208c3-c49b-45cd-bce8-b3ee6b18a204 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:46.337787 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b0c208c3-c49b-45cd-bce8-b3ee6b18a204 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a" status: 200 len: 1292 microversion: 2.1 time: 0.120136 Sep 06 21:26:46.339355 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 610/1226] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:46 2022] GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a => generated 1292 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:47.363091 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a908dc07-02dd-44e3-ba22-b7b743f6984b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:47.364772 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a908dc07-02dd-44e3-ba22-b7b743f6984b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:47.378762 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a908dc07-02dd-44e3-ba22-b7b743f6984b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:47.380185 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a908dc07-02dd-44e3-ba22-b7b743f6984b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:47.383481 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a908dc07-02dd-44e3-ba22-b7b743f6984b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:47.385116 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a908dc07-02dd-44e3-ba22-b7b743f6984b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:47.387384 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a908dc07-02dd-44e3-ba22-b7b743f6984b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:47.387793 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a908dc07-02dd-44e3-ba22-b7b743f6984b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:47.595597 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a908dc07-02dd-44e3-ba22-b7b743f6984b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:47.607785 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a908dc07-02dd-44e3-ba22-b7b743f6984b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a" status: 200 len: 1365 microversion: 2.1 time: 0.248852 Sep 06 21:26:47.621630 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 617/1227] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:47 2022] GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a => generated 1365 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:48.395115 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-45a7bf1c-7e5d-4fea-a352-46bfaaf0eb87 req-ce3abcfb-de33-4f7c-952b-5fca30df659d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03eaf3bf-fadc-452d-97c1-7faa2414a36a", "tag": "293351b9-5d85-4302-8939-0947aa6237d5"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:26:48.406737 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-45a7bf1c-7e5d-4fea-a352-46bfaaf0eb87 req-ce3abcfb-de33-4f7c-952b-5fca30df659d service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:48.407245 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-45a7bf1c-7e5d-4fea-a352-46bfaaf0eb87 req-ce3abcfb-de33-4f7c-952b-5fca30df659d service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:48.407781 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-45a7bf1c-7e5d-4fea-a352-46bfaaf0eb87 req-ce3abcfb-de33-4f7c-952b-5fca30df659d service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:48.412312 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:26:48.423309 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-45a7bf1c-7e5d-4fea-a352-46bfaaf0eb87 req-ce3abcfb-de33-4f7c-952b-5fca30df659d service nova] Creating event network-changed:293351b9-5d85-4302-8939-0947aa6237d5 for instance 03eaf3bf-fadc-452d-97c1-7faa2414a36a on hv-cinder-74915 Sep 06 21:26:48.429980 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-45a7bf1c-7e5d-4fea-a352-46bfaaf0eb87 req-ce3abcfb-de33-4f7c-952b-5fca30df659d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039710 Sep 06 21:26:48.431333 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 611/1228] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:26:48.633668 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-80cfe00a-21f9-41ef-aa75-5aee44ced610 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:48.635023 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-80cfe00a-21f9-41ef-aa75-5aee44ced610 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:48.642524 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80cfe00a-21f9-41ef-aa75-5aee44ced610 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:48.643429 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80cfe00a-21f9-41ef-aa75-5aee44ced610 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:48.643889 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80cfe00a-21f9-41ef-aa75-5aee44ced610 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:48.644632 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80cfe00a-21f9-41ef-aa75-5aee44ced610 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:48.645076 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80cfe00a-21f9-41ef-aa75-5aee44ced610 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:48.645681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80cfe00a-21f9-41ef-aa75-5aee44ced610 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:48.820479 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-80cfe00a-21f9-41ef-aa75-5aee44ced610 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:48.834671 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-80cfe00a-21f9-41ef-aa75-5aee44ced610 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a" status: 200 len: 1365 microversion: 2.1 time: 0.205154 Sep 06 21:26:48.837204 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 618/1229] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:48 2022] GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:49.860631 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0d147fb0-dd17-47d4-81d0-db9064a28827 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:49.861312 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0d147fb0-dd17-47d4-81d0-db9064a28827 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:49.869348 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d147fb0-dd17-47d4-81d0-db9064a28827 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:49.870140 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d147fb0-dd17-47d4-81d0-db9064a28827 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:49.870776 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d147fb0-dd17-47d4-81d0-db9064a28827 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:49.871669 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d147fb0-dd17-47d4-81d0-db9064a28827 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:49.872295 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d147fb0-dd17-47d4-81d0-db9064a28827 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:49.872947 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d147fb0-dd17-47d4-81d0-db9064a28827 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:50.031026 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0d147fb0-dd17-47d4-81d0-db9064a28827 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:50.040925 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0d147fb0-dd17-47d4-81d0-db9064a28827 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a" status: 200 len: 1365 microversion: 2.1 time: 0.185334 Sep 06 21:26:50.056766 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 612/1230] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:49 2022] GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:51.064172 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a52573b5-a496-4473-b0a2-067d3d3491f4 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:51.066053 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a52573b5-a496-4473-b0a2-067d3d3491f4 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:51.074954 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a52573b5-a496-4473-b0a2-067d3d3491f4 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:51.075447 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a52573b5-a496-4473-b0a2-067d3d3491f4 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:51.075894 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a52573b5-a496-4473-b0a2-067d3d3491f4 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:51.076600 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a52573b5-a496-4473-b0a2-067d3d3491f4 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:51.077079 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a52573b5-a496-4473-b0a2-067d3d3491f4 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:51.077501 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a52573b5-a496-4473-b0a2-067d3d3491f4 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:51.225956 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a52573b5-a496-4473-b0a2-067d3d3491f4 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:51.242071 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a52573b5-a496-4473-b0a2-067d3d3491f4 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a" status: 200 len: 1365 microversion: 2.1 time: 0.181603 Sep 06 21:26:51.252911 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 619/1231] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:51 2022] GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:52.267429 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-07486216-2435-4207-9188-292c242fda5c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:52.268035 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-07486216-2435-4207-9188-292c242fda5c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:52.275095 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07486216-2435-4207-9188-292c242fda5c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:52.275612 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07486216-2435-4207-9188-292c242fda5c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:52.276131 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07486216-2435-4207-9188-292c242fda5c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:52.276909 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07486216-2435-4207-9188-292c242fda5c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:52.277407 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07486216-2435-4207-9188-292c242fda5c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:52.277837 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07486216-2435-4207-9188-292c242fda5c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:52.528004 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-07486216-2435-4207-9188-292c242fda5c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:52.537159 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-07486216-2435-4207-9188-292c242fda5c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a" status: 200 len: 1365 microversion: 2.1 time: 0.273561 Sep 06 21:26:52.537735 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 613/1232] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:52 2022] GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a => generated 1365 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:53.562071 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-47e070fc-0b97-4f94-82c1-a08f209d9a58 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:53.562694 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-47e070fc-0b97-4f94-82c1-a08f209d9a58 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:53.569589 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47e070fc-0b97-4f94-82c1-a08f209d9a58 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:53.570039 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47e070fc-0b97-4f94-82c1-a08f209d9a58 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:53.570439 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47e070fc-0b97-4f94-82c1-a08f209d9a58 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:53.571177 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47e070fc-0b97-4f94-82c1-a08f209d9a58 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:53.571603 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47e070fc-0b97-4f94-82c1-a08f209d9a58 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:53.572036 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47e070fc-0b97-4f94-82c1-a08f209d9a58 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:53.733863 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-47e070fc-0b97-4f94-82c1-a08f209d9a58 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:53.741902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-47e070fc-0b97-4f94-82c1-a08f209d9a58 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a" status: 200 len: 1365 microversion: 2.1 time: 0.183781 Sep 06 21:26:53.742489 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 620/1233] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:53 2022] GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:54.766598 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6bfda79b-0925-4582-8f0b-abb723164e06 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:54.767182 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6bfda79b-0925-4582-8f0b-abb723164e06 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:54.775094 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bfda79b-0925-4582-8f0b-abb723164e06 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:54.775647 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bfda79b-0925-4582-8f0b-abb723164e06 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:54.776113 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bfda79b-0925-4582-8f0b-abb723164e06 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:54.776982 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bfda79b-0925-4582-8f0b-abb723164e06 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:54.777479 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bfda79b-0925-4582-8f0b-abb723164e06 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:54.777961 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bfda79b-0925-4582-8f0b-abb723164e06 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:54.918891 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6bfda79b-0925-4582-8f0b-abb723164e06 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:54.927474 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6bfda79b-0925-4582-8f0b-abb723164e06 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a" status: 200 len: 1365 microversion: 2.1 time: 0.165483 Sep 06 21:26:54.928050 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 614/1234] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:54 2022] GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:55.951011 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-495464c2-4210-498f-946b-839c5e961cc6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:55.951617 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-495464c2-4210-498f-946b-839c5e961cc6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:55.954101 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:26:55.959706 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-495464c2-4210-498f-946b-839c5e961cc6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:55.960217 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-495464c2-4210-498f-946b-839c5e961cc6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:55.960641 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-495464c2-4210-498f-946b-839c5e961cc6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:55.961364 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-495464c2-4210-498f-946b-839c5e961cc6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:55.961808 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-495464c2-4210-498f-946b-839c5e961cc6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:55.962225 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-495464c2-4210-498f-946b-839c5e961cc6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:56.099176 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-495464c2-4210-498f-946b-839c5e961cc6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:56.111845 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-495464c2-4210-498f-946b-839c5e961cc6 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a" status: 200 len: 1365 microversion: 2.1 time: 0.164468 Sep 06 21:26:56.112837 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 621/1235] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:55 2022] GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:57.138820 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5583252c-ebf6-44cd-8f28-9fa119992d38 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:57.139410 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5583252c-ebf6-44cd-8f28-9fa119992d38 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:57.141588 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:26:57.142633 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:26:57.150309 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5583252c-ebf6-44cd-8f28-9fa119992d38 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:57.150843 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5583252c-ebf6-44cd-8f28-9fa119992d38 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:57.151339 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5583252c-ebf6-44cd-8f28-9fa119992d38 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:57.152124 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5583252c-ebf6-44cd-8f28-9fa119992d38 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:57.152613 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5583252c-ebf6-44cd-8f28-9fa119992d38 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:57.153113 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5583252c-ebf6-44cd-8f28-9fa119992d38 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:57.303693 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5583252c-ebf6-44cd-8f28-9fa119992d38 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:57.312188 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5583252c-ebf6-44cd-8f28-9fa119992d38 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a" status: 200 len: 1365 microversion: 2.1 time: 0.178713 Sep 06 21:26:57.312818 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 615/1236] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:57 2022] GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:57.979992 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-b403e2b6-04bd-4951-a41b-e079d2b5622b req-0470c785-52ee-4e0e-935b-30cd65824201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03eaf3bf-fadc-452d-97c1-7faa2414a36a", "name": "network-vif-plugged", "status": "completed", "tag": "293351b9-5d85-4302-8939-0947aa6237d5"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:26:57.989969 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b403e2b6-04bd-4951-a41b-e079d2b5622b req-0470c785-52ee-4e0e-935b-30cd65824201 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:57.990636 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b403e2b6-04bd-4951-a41b-e079d2b5622b req-0470c785-52ee-4e0e-935b-30cd65824201 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:57.991060 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b403e2b6-04bd-4951-a41b-e079d2b5622b req-0470c785-52ee-4e0e-935b-30cd65824201 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:58.004769 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-b403e2b6-04bd-4951-a41b-e079d2b5622b req-0470c785-52ee-4e0e-935b-30cd65824201 service nova] Creating event network-vif-plugged:293351b9-5d85-4302-8939-0947aa6237d5 for instance 03eaf3bf-fadc-452d-97c1-7faa2414a36a on hv-cinder-74915 Sep 06 21:26:58.010315 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-b403e2b6-04bd-4951-a41b-e079d2b5622b req-0470c785-52ee-4e0e-935b-30cd65824201 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094366 Sep 06 21:26:58.010906 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 622/1237] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:26:58.337187 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1ffe7934-3b4c-40f2-b76d-abe29f10bb33 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:58.337774 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1ffe7934-3b4c-40f2-b76d-abe29f10bb33 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:58.347682 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ffe7934-3b4c-40f2-b76d-abe29f10bb33 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:58.348341 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ffe7934-3b4c-40f2-b76d-abe29f10bb33 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:58.348992 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ffe7934-3b4c-40f2-b76d-abe29f10bb33 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:58.350019 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ffe7934-3b4c-40f2-b76d-abe29f10bb33 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:58.350643 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ffe7934-3b4c-40f2-b76d-abe29f10bb33 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:58.351171 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ffe7934-3b4c-40f2-b76d-abe29f10bb33 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:58.507872 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1ffe7934-3b4c-40f2-b76d-abe29f10bb33 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:58.518190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1ffe7934-3b4c-40f2-b76d-abe29f10bb33 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a" status: 200 len: 1365 microversion: 2.1 time: 0.186981 Sep 06 21:26:58.518767 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 616/1238] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:58 2022] GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:26:59.543341 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7608980c-fe26-4aa8-add7-3353c985e18f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:26:59.544041 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7608980c-fe26-4aa8-add7-3353c985e18f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:26:59.550290 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7608980c-fe26-4aa8-add7-3353c985e18f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:59.550787 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7608980c-fe26-4aa8-add7-3353c985e18f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:59.551201 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7608980c-fe26-4aa8-add7-3353c985e18f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:59.551903 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7608980c-fe26-4aa8-add7-3353c985e18f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:26:59.552351 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7608980c-fe26-4aa8-add7-3353c985e18f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:26:59.552797 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7608980c-fe26-4aa8-add7-3353c985e18f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:26:59.555549 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=70 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:26:59.688747 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7608980c-fe26-4aa8-add7-3353c985e18f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:26:59.696962 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7608980c-fe26-4aa8-add7-3353c985e18f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a" status: 200 len: 1365 microversion: 2.1 time: 0.158728 Sep 06 21:26:59.697608 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 623/1239] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:26:59 2022] GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:00.719702 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b7f53174-6c77-484d-9a5a-98664e1c5cbb tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:00.720338 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b7f53174-6c77-484d-9a5a-98664e1c5cbb tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:00.727227 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7f53174-6c77-484d-9a5a-98664e1c5cbb tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:00.727806 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7f53174-6c77-484d-9a5a-98664e1c5cbb tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:00.728181 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7f53174-6c77-484d-9a5a-98664e1c5cbb tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:00.728907 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7f53174-6c77-484d-9a5a-98664e1c5cbb tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:00.729373 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7f53174-6c77-484d-9a5a-98664e1c5cbb tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:00.729751 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7f53174-6c77-484d-9a5a-98664e1c5cbb tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:00.880117 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b7f53174-6c77-484d-9a5a-98664e1c5cbb tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:00.890330 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b7f53174-6c77-484d-9a5a-98664e1c5cbb tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a" status: 200 len: 1555 microversion: 2.1 time: 0.174548 Sep 06 21:27:00.890985 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 617/1240] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:00 2022] GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a => generated 1555 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:00.913443 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-79d773b1-f779-4caa-8f99-64a080e07b4e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:00.914183 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-79d773b1-f779-4caa-8f99-64a080e07b4e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:00.921888 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79d773b1-f779-4caa-8f99-64a080e07b4e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:00.922461 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79d773b1-f779-4caa-8f99-64a080e07b4e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:00.922989 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79d773b1-f779-4caa-8f99-64a080e07b4e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:00.923770 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79d773b1-f779-4caa-8f99-64a080e07b4e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:00.924587 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79d773b1-f779-4caa-8f99-64a080e07b4e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:00.925137 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79d773b1-f779-4caa-8f99-64a080e07b4e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:01.019060 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-79d773b1-f779-4caa-8f99-64a080e07b4e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109613 Sep 06 21:27:01.027102 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 624/1241] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Sep 6 21:27:00 2022] GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:27:02.344942 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-084bd4bf-0ead-4571-9262-6c4da2a75df6 req-70913dda-aba4-4b17-9d06-f391b495cc81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03eaf3bf-fadc-452d-97c1-7faa2414a36a", "tag": "293351b9-5d85-4302-8939-0947aa6237d5"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:27:02.358344 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-084bd4bf-0ead-4571-9262-6c4da2a75df6 req-70913dda-aba4-4b17-9d06-f391b495cc81 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:02.359006 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-084bd4bf-0ead-4571-9262-6c4da2a75df6 req-70913dda-aba4-4b17-9d06-f391b495cc81 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:02.359443 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-084bd4bf-0ead-4571-9262-6c4da2a75df6 req-70913dda-aba4-4b17-9d06-f391b495cc81 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:02.372573 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-084bd4bf-0ead-4571-9262-6c4da2a75df6 req-70913dda-aba4-4b17-9d06-f391b495cc81 service nova] Creating event network-changed:293351b9-5d85-4302-8939-0947aa6237d5 for instance 03eaf3bf-fadc-452d-97c1-7faa2414a36a on hv-cinder-74915 Sep 06 21:27:02.383335 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-084bd4bf-0ead-4571-9262-6c4da2a75df6 req-70913dda-aba4-4b17-9d06-f391b495cc81 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048797 Sep 06 21:27:02.384220 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 618/1242] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:27:15.692955 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:27:15.698220 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=9 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:27:15.703850 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-2ad22c85-3e97-44bc-848f-80b05589fb0a req-4455bbb0-6f4e-4e12-8fc4-1d0580f85559 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cff6256a-f769-4f06-bab1-72090c9c4357", "tag": "f36e6285-5f0f-4ce8-862a-730e9d373c0d"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:27:15.711450 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-124eaaa5-5d78-4943-b4d6-e49e7ec3e35a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:15.711963 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-124eaaa5-5d78-4943-b4d6-e49e7ec3e35a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: cff6256a-f769-4f06-bab1-72090c9c4357] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:15.721624 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:27:15.722307 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=38 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:27:15.729384 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-124eaaa5-5d78-4943-b4d6-e49e7ec3e35a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:15.730656 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-124eaaa5-5d78-4943-b4d6-e49e7ec3e35a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:15.733679 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2ad22c85-3e97-44bc-848f-80b05589fb0a req-4455bbb0-6f4e-4e12-8fc4-1d0580f85559 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:15.734041 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-124eaaa5-5d78-4943-b4d6-e49e7ec3e35a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:15.735259 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-124eaaa5-5d78-4943-b4d6-e49e7ec3e35a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:15.735992 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2ad22c85-3e97-44bc-848f-80b05589fb0a req-4455bbb0-6f4e-4e12-8fc4-1d0580f85559 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:15.736612 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2ad22c85-3e97-44bc-848f-80b05589fb0a req-4455bbb0-6f4e-4e12-8fc4-1d0580f85559 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:15.737739 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-124eaaa5-5d78-4943-b4d6-e49e7ec3e35a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:15.738185 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-124eaaa5-5d78-4943-b4d6-e49e7ec3e35a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:15.775830 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-2ad22c85-3e97-44bc-848f-80b05589fb0a req-4455bbb0-6f4e-4e12-8fc4-1d0580f85559 service nova] Creating event network-changed:f36e6285-5f0f-4ce8-862a-730e9d373c0d for instance cff6256a-f769-4f06-bab1-72090c9c4357 on hv-cinder-74915 Sep 06 21:27:15.788258 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-2ad22c85-3e97-44bc-848f-80b05589fb0a req-4455bbb0-6f4e-4e12-8fc4-1d0580f85559 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093127 Sep 06 21:27:15.793645 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 619/1243] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:27:15.806236 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-124eaaa5-5d78-4943-b4d6-e49e7ec3e35a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: cff6256a-f769-4f06-bab1-72090c9c4357] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 21:27:15.942237 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-124eaaa5-5d78-4943-b4d6-e49e7ec3e35a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "DELETE /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357" status: 204 len: 0 microversion: 2.1 time: 0.232675 Sep 06 21:27:15.943380 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 625/1244] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Sep 6 21:27:15 2022] DELETE /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 21:27:15.955094 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3bf789cc-e54b-436c-8baa-fe979e25e856 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:15.956203 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3bf789cc-e54b-436c-8baa-fe979e25e856 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: cff6256a-f769-4f06-bab1-72090c9c4357] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:15.966587 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bf789cc-e54b-436c-8baa-fe979e25e856 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:15.970291 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bf789cc-e54b-436c-8baa-fe979e25e856 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:15.971130 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bf789cc-e54b-436c-8baa-fe979e25e856 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:15.973574 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bf789cc-e54b-436c-8baa-fe979e25e856 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:15.974230 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bf789cc-e54b-436c-8baa-fe979e25e856 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:15.974822 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bf789cc-e54b-436c-8baa-fe979e25e856 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:16.157582 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3bf789cc-e54b-436c-8baa-fe979e25e856 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:16.166834 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3bf789cc-e54b-436c-8baa-fe979e25e856 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357" status: 200 len: 1577 microversion: 2.1 time: 0.216775 Sep 06 21:27:16.169068 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 620/1245] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:15 2022] GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357 => generated 1577 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:17.192122 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-47f4df27-ba53-45be-89d6-367f3b7af661 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:17.192851 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-47f4df27-ba53-45be-89d6-367f3b7af661 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: cff6256a-f769-4f06-bab1-72090c9c4357] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:17.206107 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47f4df27-ba53-45be-89d6-367f3b7af661 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:17.206596 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47f4df27-ba53-45be-89d6-367f3b7af661 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:17.207037 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47f4df27-ba53-45be-89d6-367f3b7af661 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:17.207755 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47f4df27-ba53-45be-89d6-367f3b7af661 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:17.208203 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47f4df27-ba53-45be-89d6-367f3b7af661 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:17.208631 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47f4df27-ba53-45be-89d6-367f3b7af661 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:17.406377 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-47f4df27-ba53-45be-89d6-367f3b7af661 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:17.414769 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-47f4df27-ba53-45be-89d6-367f3b7af661 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357" status: 200 len: 1577 microversion: 2.1 time: 0.226916 Sep 06 21:27:17.432886 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 626/1246] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:17 2022] GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357 => generated 1577 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:27:18.442197 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-56ce1c46-fdde-4c0c-89c6-b90483b5ae6a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:18.443595 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-56ce1c46-fdde-4c0c-89c6-b90483b5ae6a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: cff6256a-f769-4f06-bab1-72090c9c4357] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:18.453341 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56ce1c46-fdde-4c0c-89c6-b90483b5ae6a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:18.454124 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56ce1c46-fdde-4c0c-89c6-b90483b5ae6a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:18.454732 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56ce1c46-fdde-4c0c-89c6-b90483b5ae6a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:18.455684 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56ce1c46-fdde-4c0c-89c6-b90483b5ae6a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:18.456311 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56ce1c46-fdde-4c0c-89c6-b90483b5ae6a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:18.457122 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56ce1c46-fdde-4c0c-89c6-b90483b5ae6a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:18.562787 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-12378cfb-6bec-479a-b59f-c1ba7155672b req-1224e1a2-9934-49ff-ab82-4bdb4dda8a78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cff6256a-f769-4f06-bab1-72090c9c4357", "name": "network-vif-deleted", "tag": "f36e6285-5f0f-4ce8-862a-730e9d373c0d"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:27:18.567999 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-56ce1c46-fdde-4c0c-89c6-b90483b5ae6a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:18.576163 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-12378cfb-6bec-479a-b59f-c1ba7155672b req-1224e1a2-9934-49ff-ab82-4bdb4dda8a78 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:18.577051 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-12378cfb-6bec-479a-b59f-c1ba7155672b req-1224e1a2-9934-49ff-ab82-4bdb4dda8a78 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:18.577664 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-12378cfb-6bec-479a-b59f-c1ba7155672b req-1224e1a2-9934-49ff-ab82-4bdb4dda8a78 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:18.583578 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-56ce1c46-fdde-4c0c-89c6-b90483b5ae6a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357" status: 200 len: 1392 microversion: 2.1 time: 0.148347 Sep 06 21:27:18.588764 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 621/1247] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:18 2022] GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:18.595856 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-12378cfb-6bec-479a-b59f-c1ba7155672b req-1224e1a2-9934-49ff-ab82-4bdb4dda8a78 service nova] Creating event network-vif-deleted:f36e6285-5f0f-4ce8-862a-730e9d373c0d for instance cff6256a-f769-4f06-bab1-72090c9c4357 on hv-cinder-74915 Sep 06 21:27:18.601666 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-12378cfb-6bec-479a-b59f-c1ba7155672b req-1224e1a2-9934-49ff-ab82-4bdb4dda8a78 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042156 Sep 06 21:27:18.602793 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 627/1248] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:27:19.613376 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8364c584-9f5a-4a15-90e3-2e6c145288e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:19.614143 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8364c584-9f5a-4a15-90e3-2e6c145288e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: cff6256a-f769-4f06-bab1-72090c9c4357] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:19.621774 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8364c584-9f5a-4a15-90e3-2e6c145288e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:19.622601 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8364c584-9f5a-4a15-90e3-2e6c145288e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:19.622798 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8364c584-9f5a-4a15-90e3-2e6c145288e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:19.623812 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8364c584-9f5a-4a15-90e3-2e6c145288e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:19.624233 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8364c584-9f5a-4a15-90e3-2e6c145288e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:19.624906 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8364c584-9f5a-4a15-90e3-2e6c145288e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:19.671715 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8364c584-9f5a-4a15-90e3-2e6c145288e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:19.672238 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8364c584-9f5a-4a15-90e3-2e6c145288e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:19.672645 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8364c584-9f5a-4a15-90e3-2e6c145288e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:19.673131 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-8364c584-9f5a-4a15-90e3-2e6c145288e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lazy-loading 'fault' on Instance uuid cff6256a-f769-4f06-bab1-72090c9c4357 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:27:19.735756 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8364c584-9f5a-4a15-90e3-2e6c145288e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:19.747986 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8364c584-9f5a-4a15-90e3-2e6c145288e1 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357" status: 200 len: 1231 microversion: 2.1 time: 0.138679 Sep 06 21:27:19.748734 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 622/1249] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:19 2022] GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357 => generated 1231 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:20.333399 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7ef70fea-ca02-48c5-a32f-c616bd86feed tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Action: 'create', calling method: .version_select at 0x7f04ce6a0e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1528109863", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6nsuCA2AH9Z6Bv2GLlBXssvA0msq5bzn3ndDOoVmhxFvDO8FtmwH5aKvotlvs3peS5ktfrKPOZwwuZwsHMMCN4PMqFx6HYM1dZTJSZUaDAxiO4YbzoPHUeDaJlgwjCaw=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:27:20.352013 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-7ef70fea-ca02-48c5-a32f-c616bd86feed tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Getting quotas for project ca88b1d59a924130a3fa43b0b256c33e. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:27:20.356965 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-7ef70fea-ca02-48c5-a32f-c616bd86feed tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Getting quotas for user d52264275fdb411484cfc6b39b625d8b and project ca88b1d59a924130a3fa43b0b256c33e. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:27:20.382368 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7ef70fea-ca02-48c5-a32f-c616bd86feed tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053215 Sep 06 21:27:20.382983 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 628/1250] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Sep 6 21:27:20 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:27:20.498348 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-278c13c5-d43d-498e-924b-8c3b8d1b38e9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-863873276", "imageRef": "ae586a64-01bd-4102-96b2-79fefc331868", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1528109863", "networks": [{"uuid": "50e365fe-179d-4274-a5f2-4892f55b4711"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:27:20.555219 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-278c13c5-d43d-498e-924b-8c3b8d1b38e9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] validate_networks() for [('50e365fe-179d-4274-a5f2-4892f55b4711', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 21:27:20.778310 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-872d73d2-b244-4c89-a251-ea46b1213d5a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:20.779196 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-872d73d2-b244-4c89-a251-ea46b1213d5a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: cff6256a-f769-4f06-bab1-72090c9c4357] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:20.788462 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-872d73d2-b244-4c89-a251-ea46b1213d5a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:20.789113 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-872d73d2-b244-4c89-a251-ea46b1213d5a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:20.789558 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-872d73d2-b244-4c89-a251-ea46b1213d5a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:20.790276 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-872d73d2-b244-4c89-a251-ea46b1213d5a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:20.791077 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-872d73d2-b244-4c89-a251-ea46b1213d5a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:20.791506 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-872d73d2-b244-4c89-a251-ea46b1213d5a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:20.807116 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-872d73d2-b244-4c89-a251-ea46b1213d5a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] HTTP exception thrown: Instance cff6256a-f769-4f06-bab1-72090c9c4357 could not be found. Sep 06 21:27:20.808902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-872d73d2-b244-4c89-a251-ea46b1213d5a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Request method failure captured: Sep 06 21:27:20.808902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357 HTTP/1.1 Sep 06 21:27:20.808902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:27:20.808902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:27:20.808902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:27:20.808902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:27:20.808902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:27:20.808902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:27:20.808902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:27:20.808902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:27:20.808902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7jQwuYbSnhwsURE38g_NHxq8bkKeKTGiasuG8R4J_ohgqXTkmcNemP-pvRgIf7MR28ChWbVjrUwIwrlbvTaNHxgEiRZjVhDAuiU5kjaT_8n44UF6j6b14JfeGTZ8SassSWNa8C9Bt9GxMa4yojoeSluWQiZXZE308nZw0eafQVQ1xg Sep 06 21:27:20.808902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:27:20.808902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:27:20.808902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:27:20.808902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:27:20.808902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:27:20.808902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:27:20.808902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: 5801984f41a043daa52dbef9de89df9a Sep 06 21:27:20.808902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-TestVolumeBootPattern-1838133913 Sep 06 21:27:20.808902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:27:20.808902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:27:20.810462 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5801984f41a043daa52dbef9de89df9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5801984f41a043daa52dbef9de89df9a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5801984f41a043daa52dbef9de89df9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5801984f41a043daa52dbef9de89df9a"}]}] Sep 06 21:27:20.810462 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-TestVolumeBootPattern-1838133913 Sep 06 21:27:20.810462 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 5801984f41a043daa52dbef9de89df9a Sep 06 21:27:20.810462 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestVolumeBootPattern-1838133913 Sep 06 21:27:20.810462 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-TestVolumeBootPattern-1838133913-project Sep 06 21:27:20.810462 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:27:20.810462 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:27:20.810462 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: 6d0c1c510b0a4fa39927f7f92352d034 Sep 06 21:27:20.810462 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-TestVolumeBootPattern-1838133913-project Sep 06 21:27:20.810462 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: > Sep 06 21:27:20.810462 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Instance cff6256a-f769-4f06-bab1-72090c9c4357 could not be found. Sep 06 21:27:20.810462 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'id': 'cff6256a-f769-4f06-bab1-72090c9c4357'} Sep 06 21:27:20.811364 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:27:20.811364 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:27:20.811364 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:27:20.811364 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:27:20.811364 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:27:20.811364 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:27:20.811364 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:27:20.811364 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:27:20.811364 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:27:20.811364 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:27:20.811364 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cff6256a-f769-4f06-bab1-72090c9c4357 could not be found. Sep 06 21:27:20.811364 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:27:20.811364 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:27:20.811364 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:27:20.811364 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:27:20.811364 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:27:20.811364 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:27:20.811364 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:27:20.811364 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:27:20.811364 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:27:20.812925 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:27:20.812925 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:27:20.812925 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:27:20.812925 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:27:20.812925 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:27:20.812925 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:27:20.812925 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:27:20.812925 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cff6256a-f769-4f06-bab1-72090c9c4357 could not be found. Sep 06 21:27:20.812925 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:27:20.812925 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:27:20.812925 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:27:20.812925 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:27:20.812925 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:27:20.812925 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:27:20.812925 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:27:20.812925 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:27:20.812925 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cff6256a-f769-4f06-bab1-72090c9c4357 could not be found. Sep 06 21:27:20.812925 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:27:20.814813 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-872d73d2-b244-4c89-a251-ea46b1213d5a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Returning 404 to user: Instance cff6256a-f769-4f06-bab1-72090c9c4357 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:27:20.814813 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-872d73d2-b244-4c89-a251-ea46b1213d5a tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357" status: 404 len: 111 microversion: 2.1 time: 0.036052 Sep 06 21:27:20.814813 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 629/1251] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:20 2022] GET /compute/v2.1/servers/cff6256a-f769-4f06-bab1-72090c9c4357 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:27:20.955520 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-278c13c5-d43d-498e-924b-8c3b8d1b38e9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 21:27:20.956057 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-278c13c5-d43d-498e-924b-8c3b8d1b38e9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 21:27:20.956475 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-278c13c5-d43d-498e-924b-8c3b8d1b38e9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 21:27:20.956939 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-278c13c5-d43d-498e-924b-8c3b8d1b38e9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 21:27:20.957344 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-278c13c5-d43d-498e-924b-8c3b8d1b38e9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 21:27:20.967662 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-278c13c5-d43d-498e-924b-8c3b8d1b38e9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:20.968265 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-278c13c5-d43d-498e-924b-8c3b8d1b38e9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:20.968711 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-278c13c5-d43d-498e-924b-8c3b8d1b38e9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:20.969735 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-278c13c5-d43d-498e-924b-8c3b8d1b38e9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:20.970329 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-278c13c5-d43d-498e-924b-8c3b8d1b38e9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:20.970908 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-278c13c5-d43d-498e-924b-8c3b8d1b38e9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:20.993329 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-278c13c5-d43d-498e-924b-8c3b8d1b38e9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Getting quotas for project ca88b1d59a924130a3fa43b0b256c33e. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:27:20.997998 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-278c13c5-d43d-498e-924b-8c3b8d1b38e9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Getting quotas for user d52264275fdb411484cfc6b39b625d8b and project ca88b1d59a924130a3fa43b0b256c33e. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:27:21.012940 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-278c13c5-d43d-498e-924b-8c3b8d1b38e9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 21:27:21.015424 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-278c13c5-d43d-498e-924b-8c3b8d1b38e9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ae586a64-01bd-4102-96b2-79fefc331868',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 21:27:21.073557 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-278c13c5-d43d-498e-924b-8c3b8d1b38e9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581783 Sep 06 21:27:21.074535 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 623/1252] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Sep 6 21:27:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 21:27:21.089910 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-86b3e6b5-d234-46cd-bb33-726335b7809a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:21.090700 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-86b3e6b5-d234-46cd-bb33-726335b7809a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:21.166123 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-86b3e6b5-d234-46cd-bb33-726335b7809a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:21.176249 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-86b3e6b5-d234-46cd-bb33-726335b7809a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1258 microversion: 2.1 time: 0.091948 Sep 06 21:27:21.176883 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 630/1253] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:21 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1258 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:22.204184 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1aa62d1e-015e-4c23-80d2-8a72ac392cff tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:22.205090 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1aa62d1e-015e-4c23-80d2-8a72ac392cff tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:22.218401 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1aa62d1e-015e-4c23-80d2-8a72ac392cff tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:22.218882 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1aa62d1e-015e-4c23-80d2-8a72ac392cff tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:22.219342 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1aa62d1e-015e-4c23-80d2-8a72ac392cff tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:22.220137 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1aa62d1e-015e-4c23-80d2-8a72ac392cff tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:22.220585 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1aa62d1e-015e-4c23-80d2-8a72ac392cff tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:22.221041 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1aa62d1e-015e-4c23-80d2-8a72ac392cff tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:22.293747 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1aa62d1e-015e-4c23-80d2-8a72ac392cff tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:22.301773 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1aa62d1e-015e-4c23-80d2-8a72ac392cff tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1310 microversion: 2.1 time: 0.105343 Sep 06 21:27:22.302316 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 624/1254] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:22 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1310 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:23.325490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7d9e8729-d4e7-441a-be11-8377edd5d847 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:23.326301 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7d9e8729-d4e7-441a-be11-8377edd5d847 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:23.341289 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d9e8729-d4e7-441a-be11-8377edd5d847 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:23.341825 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d9e8729-d4e7-441a-be11-8377edd5d847 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:23.342251 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d9e8729-d4e7-441a-be11-8377edd5d847 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:23.343049 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d9e8729-d4e7-441a-be11-8377edd5d847 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:23.343467 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d9e8729-d4e7-441a-be11-8377edd5d847 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:23.343873 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d9e8729-d4e7-441a-be11-8377edd5d847 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:23.631060 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7d9e8729-d4e7-441a-be11-8377edd5d847 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:23.667794 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7d9e8729-d4e7-441a-be11-8377edd5d847 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1358 microversion: 2.1 time: 0.325740 Sep 06 21:27:23.672608 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 631/1255] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:23 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1358 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:24.605262 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d9ad2793-e422-4e8a-8a08-aa55ff1964b2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:24.605842 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d9ad2793-e422-4e8a-8a08-aa55ff1964b2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:24.617254 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d9ad2793-e422-4e8a-8a08-aa55ff1964b2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:24.618463 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d9ad2793-e422-4e8a-8a08-aa55ff1964b2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:24.619090 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d9ad2793-e422-4e8a-8a08-aa55ff1964b2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:24.619964 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d9ad2793-e422-4e8a-8a08-aa55ff1964b2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:24.620574 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d9ad2793-e422-4e8a-8a08-aa55ff1964b2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:24.621173 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d9ad2793-e422-4e8a-8a08-aa55ff1964b2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:24.623470 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-383ac606-b437-47b7-93e3-8ef9ebb0c037 req-0d6c7a08-ccb5-468d-ae47-a7447d913d95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4677a622-ebd6-468d-b82d-1a8b2ceae7d7", "tag": "abdf5cae-baf0-420e-8104-fe8acf77ad2f"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:27:24.645404 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-383ac606-b437-47b7-93e3-8ef9ebb0c037 req-0d6c7a08-ccb5-468d-ae47-a7447d913d95 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:24.649071 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-383ac606-b437-47b7-93e3-8ef9ebb0c037 req-0d6c7a08-ccb5-468d-ae47-a7447d913d95 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:24.649522 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-383ac606-b437-47b7-93e3-8ef9ebb0c037 req-0d6c7a08-ccb5-468d-ae47-a7447d913d95 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:24.650765 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d9ad2793-e422-4e8a-8a08-aa55ff1964b2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 21:27:24.687297 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-383ac606-b437-47b7-93e3-8ef9ebb0c037 req-0d6c7a08-ccb5-468d-ae47-a7447d913d95 service nova] Creating event network-changed:abdf5cae-baf0-420e-8104-fe8acf77ad2f for instance 4677a622-ebd6-468d-b82d-1a8b2ceae7d7 on hv-cinder-74915 Sep 06 21:27:24.693868 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-383ac606-b437-47b7-93e3-8ef9ebb0c037 req-0d6c7a08-ccb5-468d-ae47-a7447d913d95 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074582 Sep 06 21:27:24.694733 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 632/1256] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 21:27:24.701573 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e645ae13-2977-4757-9586-47b6069eb915 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:24.702622 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e645ae13-2977-4757-9586-47b6069eb915 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:24.709160 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e645ae13-2977-4757-9586-47b6069eb915 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:24.709761 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e645ae13-2977-4757-9586-47b6069eb915 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:24.710293 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e645ae13-2977-4757-9586-47b6069eb915 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:24.711104 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e645ae13-2977-4757-9586-47b6069eb915 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:24.711812 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e645ae13-2977-4757-9586-47b6069eb915 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:24.712283 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e645ae13-2977-4757-9586-47b6069eb915 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:24.745205 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d9ad2793-e422-4e8a-8a08-aa55ff1964b2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 204 len: 0 microversion: 2.1 time: 0.143382 Sep 06 21:27:24.745818 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 625/1257] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Sep 6 21:27:24 2022] DELETE /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 21:27:24.754975 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-acb13949-2af6-4002-b8e9-190008d26310 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:24.755916 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-acb13949-2af6-4002-b8e9-190008d26310 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:24.762381 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acb13949-2af6-4002-b8e9-190008d26310 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:24.762853 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acb13949-2af6-4002-b8e9-190008d26310 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:24.763323 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acb13949-2af6-4002-b8e9-190008d26310 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:24.764275 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acb13949-2af6-4002-b8e9-190008d26310 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:24.764754 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acb13949-2af6-4002-b8e9-190008d26310 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:24.765169 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acb13949-2af6-4002-b8e9-190008d26310 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:24.859541 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e645ae13-2977-4757-9586-47b6069eb915 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:24.867726 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e645ae13-2977-4757-9586-47b6069eb915 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1358 microversion: 2.1 time: 0.171386 Sep 06 21:27:24.868464 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 633/1258] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:24 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:24.931265 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-acb13949-2af6-4002-b8e9-190008d26310 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:24.945701 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-acb13949-2af6-4002-b8e9-190008d26310 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 200 len: 1578 microversion: 2.1 time: 0.194899 Sep 06 21:27:24.946621 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 626/1259] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:24 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 1578 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:27:25.891227 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ce0ef6ef-5acb-4674-8074-6e0377fb989c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:25.891826 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ce0ef6ef-5acb-4674-8074-6e0377fb989c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:25.908642 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce0ef6ef-5acb-4674-8074-6e0377fb989c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:25.909129 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce0ef6ef-5acb-4674-8074-6e0377fb989c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:25.909503 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce0ef6ef-5acb-4674-8074-6e0377fb989c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:25.910212 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce0ef6ef-5acb-4674-8074-6e0377fb989c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:25.910659 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce0ef6ef-5acb-4674-8074-6e0377fb989c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:25.911079 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce0ef6ef-5acb-4674-8074-6e0377fb989c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:25.969805 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4db66a0c-14ad-4356-8475-b9896de68fc2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:25.970582 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4db66a0c-14ad-4356-8475-b9896de68fc2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:25.977340 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4db66a0c-14ad-4356-8475-b9896de68fc2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:25.977894 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4db66a0c-14ad-4356-8475-b9896de68fc2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:25.978401 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4db66a0c-14ad-4356-8475-b9896de68fc2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:25.979174 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4db66a0c-14ad-4356-8475-b9896de68fc2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:25.979693 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4db66a0c-14ad-4356-8475-b9896de68fc2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:25.980178 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4db66a0c-14ad-4356-8475-b9896de68fc2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:26.054306 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ce0ef6ef-5acb-4674-8074-6e0377fb989c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:26.062284 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ce0ef6ef-5acb-4674-8074-6e0377fb989c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1358 microversion: 2.1 time: 0.175042 Sep 06 21:27:26.062884 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 634/1260] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:25 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:26.113884 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4db66a0c-14ad-4356-8475-b9896de68fc2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:26.122279 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4db66a0c-14ad-4356-8475-b9896de68fc2 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 200 len: 1578 microversion: 2.1 time: 0.156491 Sep 06 21:27:26.122849 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 627/1261] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:25 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:27.085926 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5ee16dab-b314-4cf3-bf2e-d1137abfb5f2 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:27.086556 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5ee16dab-b314-4cf3-bf2e-d1137abfb5f2 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:27.093636 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ee16dab-b314-4cf3-bf2e-d1137abfb5f2 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:27.094088 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ee16dab-b314-4cf3-bf2e-d1137abfb5f2 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:27.094517 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ee16dab-b314-4cf3-bf2e-d1137abfb5f2 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:27.095234 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ee16dab-b314-4cf3-bf2e-d1137abfb5f2 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:27.095675 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ee16dab-b314-4cf3-bf2e-d1137abfb5f2 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:27.096092 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ee16dab-b314-4cf3-bf2e-d1137abfb5f2 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:27.152443 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2da8f62e-f615-4392-9694-267cfb2bf410 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:27.153175 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2da8f62e-f615-4392-9694-267cfb2bf410 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:27.167734 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2da8f62e-f615-4392-9694-267cfb2bf410 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:27.168585 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2da8f62e-f615-4392-9694-267cfb2bf410 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:27.169050 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2da8f62e-f615-4392-9694-267cfb2bf410 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:27.169797 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2da8f62e-f615-4392-9694-267cfb2bf410 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:27.170265 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2da8f62e-f615-4392-9694-267cfb2bf410 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:27.170689 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2da8f62e-f615-4392-9694-267cfb2bf410 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:27.252868 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5ee16dab-b314-4cf3-bf2e-d1137abfb5f2 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:27.261315 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5ee16dab-b314-4cf3-bf2e-d1137abfb5f2 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1358 microversion: 2.1 time: 0.179215 Sep 06 21:27:27.261893 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 635/1262] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:27 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:27.360315 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2da8f62e-f615-4392-9694-267cfb2bf410 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:27.368852 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2da8f62e-f615-4392-9694-267cfb2bf410 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 200 len: 1578 microversion: 2.1 time: 0.220556 Sep 06 21:27:27.380678 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 628/1263] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:27 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 1578 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:28.284605 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4a97ad1c-5e2b-48db-9790-815503621b5f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:28.286454 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4a97ad1c-5e2b-48db-9790-815503621b5f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:28.293696 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4a97ad1c-5e2b-48db-9790-815503621b5f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:28.294183 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4a97ad1c-5e2b-48db-9790-815503621b5f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:28.294618 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4a97ad1c-5e2b-48db-9790-815503621b5f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:28.295324 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4a97ad1c-5e2b-48db-9790-815503621b5f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:28.295867 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4a97ad1c-5e2b-48db-9790-815503621b5f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:28.296290 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4a97ad1c-5e2b-48db-9790-815503621b5f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:28.394008 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a89e0e5f-e864-48ea-9909-81eb7038ad1d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:28.394568 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a89e0e5f-e864-48ea-9909-81eb7038ad1d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:28.401512 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a89e0e5f-e864-48ea-9909-81eb7038ad1d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:28.401995 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a89e0e5f-e864-48ea-9909-81eb7038ad1d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:28.402436 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a89e0e5f-e864-48ea-9909-81eb7038ad1d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:28.403129 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a89e0e5f-e864-48ea-9909-81eb7038ad1d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:28.403574 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a89e0e5f-e864-48ea-9909-81eb7038ad1d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:28.403993 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a89e0e5f-e864-48ea-9909-81eb7038ad1d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:28.428376 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4a97ad1c-5e2b-48db-9790-815503621b5f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:28.436349 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4a97ad1c-5e2b-48db-9790-815503621b5f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1358 microversion: 2.1 time: 0.156316 Sep 06 21:27:28.436975 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 636/1264] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:28 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:28.560180 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a89e0e5f-e864-48ea-9909-81eb7038ad1d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:28.568409 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a89e0e5f-e864-48ea-9909-81eb7038ad1d tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 200 len: 1578 microversion: 2.1 time: 0.178318 Sep 06 21:27:28.569030 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 629/1265] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:28 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 1578 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:29.463429 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-13c9d49e-4b5b-42a2-97eb-5ec940546d9c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:29.464593 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-13c9d49e-4b5b-42a2-97eb-5ec940546d9c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:29.474243 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13c9d49e-4b5b-42a2-97eb-5ec940546d9c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:29.474728 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13c9d49e-4b5b-42a2-97eb-5ec940546d9c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:29.475145 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13c9d49e-4b5b-42a2-97eb-5ec940546d9c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:29.475871 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13c9d49e-4b5b-42a2-97eb-5ec940546d9c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:29.476322 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13c9d49e-4b5b-42a2-97eb-5ec940546d9c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:29.476778 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13c9d49e-4b5b-42a2-97eb-5ec940546d9c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:29.593676 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d40f0cd6-633a-4c05-a2a4-7905353b9e68 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:29.594295 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d40f0cd6-633a-4c05-a2a4-7905353b9e68 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:29.601323 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d40f0cd6-633a-4c05-a2a4-7905353b9e68 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:29.602002 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d40f0cd6-633a-4c05-a2a4-7905353b9e68 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:29.602433 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d40f0cd6-633a-4c05-a2a4-7905353b9e68 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:29.604098 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d40f0cd6-633a-4c05-a2a4-7905353b9e68 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:29.604754 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d40f0cd6-633a-4c05-a2a4-7905353b9e68 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:29.605346 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d40f0cd6-633a-4c05-a2a4-7905353b9e68 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:29.629297 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-13c9d49e-4b5b-42a2-97eb-5ec940546d9c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:29.638725 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-13c9d49e-4b5b-42a2-97eb-5ec940546d9c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1358 microversion: 2.1 time: 0.181799 Sep 06 21:27:29.642017 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 637/1266] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:29 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:29.786785 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d40f0cd6-633a-4c05-a2a4-7905353b9e68 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:29.796179 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d40f0cd6-633a-4c05-a2a4-7905353b9e68 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 200 len: 1578 microversion: 2.1 time: 0.207147 Sep 06 21:27:29.797627 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 630/1267] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:29 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 1578 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:27:30.667452 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cb356a1f-4bc9-43ce-a6ce-550951900c7c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:30.668859 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cb356a1f-4bc9-43ce-a6ce-550951900c7c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:30.673546 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 21:27:30.674010 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Tue Sep 6 21:27:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 (ip 10.222.0.79) !!! Sep 06 21:27:30.686451 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb356a1f-4bc9-43ce-a6ce-550951900c7c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:30.687477 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb356a1f-4bc9-43ce-a6ce-550951900c7c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:30.688182 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb356a1f-4bc9-43ce-a6ce-550951900c7c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:30.688954 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb356a1f-4bc9-43ce-a6ce-550951900c7c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:30.689410 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb356a1f-4bc9-43ce-a6ce-550951900c7c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:30.690012 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb356a1f-4bc9-43ce-a6ce-550951900c7c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:30.819749 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d70b7bdc-45c1-4fbe-9553-9895899b43ca tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:30.820394 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d70b7bdc-45c1-4fbe-9553-9895899b43ca tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:30.826340 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-cb356a1f-4bc9-43ce-a6ce-550951900c7c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:30.827326 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d70b7bdc-45c1-4fbe-9553-9895899b43ca tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:30.827812 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d70b7bdc-45c1-4fbe-9553-9895899b43ca tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:30.828210 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d70b7bdc-45c1-4fbe-9553-9895899b43ca tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:30.829029 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d70b7bdc-45c1-4fbe-9553-9895899b43ca tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:30.829476 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d70b7bdc-45c1-4fbe-9553-9895899b43ca tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:30.829899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d70b7bdc-45c1-4fbe-9553-9895899b43ca tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:30.835452 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cb356a1f-4bc9-43ce-a6ce-550951900c7c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1358 microversion: 2.1 time: 0.171932 Sep 06 21:27:30.835452 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 638/1268] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:30 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:30.980607 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d70b7bdc-45c1-4fbe-9553-9895899b43ca tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:30.982959 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:27:30.990090 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d70b7bdc-45c1-4fbe-9553-9895899b43ca tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 200 len: 1578 microversion: 2.1 time: 0.174304 Sep 06 21:27:30.990662 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 631/1269] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:30 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 1578 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:31.864595 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dec774ee-c5d8-49b9-b040-616ee4b7214f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:31.865601 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dec774ee-c5d8-49b9-b040-616ee4b7214f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:31.868588 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:27:31.878324 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dec774ee-c5d8-49b9-b040-616ee4b7214f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:31.878823 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dec774ee-c5d8-49b9-b040-616ee4b7214f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:31.879411 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dec774ee-c5d8-49b9-b040-616ee4b7214f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:31.880172 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dec774ee-c5d8-49b9-b040-616ee4b7214f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:31.880681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dec774ee-c5d8-49b9-b040-616ee4b7214f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:31.881107 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dec774ee-c5d8-49b9-b040-616ee4b7214f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:32.013390 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d6de676-ac12-4931-b648-f1cfdd55c788 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:32.014292 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7d6de676-ac12-4931-b648-f1cfdd55c788 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:32.016409 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:27:32.031283 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d6de676-ac12-4931-b648-f1cfdd55c788 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:32.031796 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d6de676-ac12-4931-b648-f1cfdd55c788 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:32.032202 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d6de676-ac12-4931-b648-f1cfdd55c788 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:32.032932 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d6de676-ac12-4931-b648-f1cfdd55c788 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:32.033391 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d6de676-ac12-4931-b648-f1cfdd55c788 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:32.033861 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d6de676-ac12-4931-b648-f1cfdd55c788 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:32.039664 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-dec774ee-c5d8-49b9-b040-616ee4b7214f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:32.048084 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dec774ee-c5d8-49b9-b040-616ee4b7214f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1358 microversion: 2.1 time: 0.189486 Sep 06 21:27:32.048788 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 639/1270] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:31 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:32.191928 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7d6de676-ac12-4931-b648-f1cfdd55c788 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:32.200145 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7d6de676-ac12-4931-b648-f1cfdd55c788 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 200 len: 1578 microversion: 2.1 time: 0.191044 Sep 06 21:27:32.200943 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 632/1271] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:32 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 1578 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:27:33.073720 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6f8d53d9-220c-4eac-a868-89d53c219e1b tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:33.074434 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6f8d53d9-220c-4eac-a868-89d53c219e1b tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:33.082281 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f8d53d9-220c-4eac-a868-89d53c219e1b tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:33.082774 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f8d53d9-220c-4eac-a868-89d53c219e1b tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:33.083218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f8d53d9-220c-4eac-a868-89d53c219e1b tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:33.083931 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f8d53d9-220c-4eac-a868-89d53c219e1b tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:33.084378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f8d53d9-220c-4eac-a868-89d53c219e1b tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:33.091743 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6f8d53d9-220c-4eac-a868-89d53c219e1b tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:33.224003 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-23444448-bfcf-4151-829e-9512efd77690 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:33.224705 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-23444448-bfcf-4151-829e-9512efd77690 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:33.231380 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23444448-bfcf-4151-829e-9512efd77690 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:33.231863 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23444448-bfcf-4151-829e-9512efd77690 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:33.232303 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23444448-bfcf-4151-829e-9512efd77690 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:33.233035 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23444448-bfcf-4151-829e-9512efd77690 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:33.233456 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23444448-bfcf-4151-829e-9512efd77690 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:33.233908 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23444448-bfcf-4151-829e-9512efd77690 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:33.236362 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6f8d53d9-220c-4eac-a868-89d53c219e1b tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:33.244274 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6f8d53d9-220c-4eac-a868-89d53c219e1b tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1358 microversion: 2.1 time: 0.176717 Sep 06 21:27:33.244978 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 640/1272] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:33 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:33.386267 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-23444448-bfcf-4151-829e-9512efd77690 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:33.397282 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-23444448-bfcf-4151-829e-9512efd77690 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 200 len: 1578 microversion: 2.1 time: 0.177386 Sep 06 21:27:33.398088 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 633/1273] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:33 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 1578 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:34.270104 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cb2b3f3b-7fe6-4be5-8b60-7e66c9639171 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:34.270743 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cb2b3f3b-7fe6-4be5-8b60-7e66c9639171 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:34.277735 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb2b3f3b-7fe6-4be5-8b60-7e66c9639171 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:34.278224 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb2b3f3b-7fe6-4be5-8b60-7e66c9639171 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:34.278647 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb2b3f3b-7fe6-4be5-8b60-7e66c9639171 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:34.279345 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb2b3f3b-7fe6-4be5-8b60-7e66c9639171 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:34.279792 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb2b3f3b-7fe6-4be5-8b60-7e66c9639171 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:34.280211 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb2b3f3b-7fe6-4be5-8b60-7e66c9639171 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:34.416194 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-cb2b3f3b-7fe6-4be5-8b60-7e66c9639171 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:34.421286 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ed836f55-d296-48fb-93c9-fffefb03bd60 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:34.421871 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ed836f55-d296-48fb-93c9-fffefb03bd60 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:34.424585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cb2b3f3b-7fe6-4be5-8b60-7e66c9639171 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1358 microversion: 2.1 time: 0.159473 Sep 06 21:27:34.425230 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 641/1274] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:34 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:34.428695 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed836f55-d296-48fb-93c9-fffefb03bd60 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:34.429172 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed836f55-d296-48fb-93c9-fffefb03bd60 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:34.429599 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed836f55-d296-48fb-93c9-fffefb03bd60 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:34.430344 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed836f55-d296-48fb-93c9-fffefb03bd60 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:34.430783 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed836f55-d296-48fb-93c9-fffefb03bd60 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:34.431255 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed836f55-d296-48fb-93c9-fffefb03bd60 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:34.572438 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ed836f55-d296-48fb-93c9-fffefb03bd60 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:34.575972 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:27:34.581972 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ed836f55-d296-48fb-93c9-fffefb03bd60 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 200 len: 1578 microversion: 2.1 time: 0.164716 Sep 06 21:27:34.582533 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 634/1275] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:34 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:35.451896 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fd361986-0eab-4f4a-b316-ee311886ed7d tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:35.452944 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fd361986-0eab-4f4a-b316-ee311886ed7d tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:35.463861 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd361986-0eab-4f4a-b316-ee311886ed7d tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:35.464646 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd361986-0eab-4f4a-b316-ee311886ed7d tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:35.465415 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd361986-0eab-4f4a-b316-ee311886ed7d tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:35.466548 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd361986-0eab-4f4a-b316-ee311886ed7d tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:35.467290 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd361986-0eab-4f4a-b316-ee311886ed7d tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:35.467992 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd361986-0eab-4f4a-b316-ee311886ed7d tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:35.606220 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-92c4945d-bcae-4d49-8358-8e8411dffbee tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:35.606953 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-92c4945d-bcae-4d49-8358-8e8411dffbee tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:35.614757 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92c4945d-bcae-4d49-8358-8e8411dffbee tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:35.615250 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92c4945d-bcae-4d49-8358-8e8411dffbee tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:35.615686 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92c4945d-bcae-4d49-8358-8e8411dffbee tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:35.616394 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92c4945d-bcae-4d49-8358-8e8411dffbee tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:35.617059 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92c4945d-bcae-4d49-8358-8e8411dffbee tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:35.617477 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92c4945d-bcae-4d49-8358-8e8411dffbee tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:35.618882 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-fd361986-0eab-4f4a-b316-ee311886ed7d tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:35.626904 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fd361986-0eab-4f4a-b316-ee311886ed7d tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1358 microversion: 2.1 time: 0.181629 Sep 06 21:27:35.627723 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 642/1276] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:35 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:35.756592 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-92c4945d-bcae-4d49-8358-8e8411dffbee tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:35.764538 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-92c4945d-bcae-4d49-8358-8e8411dffbee tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 200 len: 1578 microversion: 2.1 time: 0.162658 Sep 06 21:27:35.765188 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 635/1277] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:35 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:36.653786 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b51522e3-b2e5-4251-aeaa-e262534657cc tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:36.654799 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b51522e3-b2e5-4251-aeaa-e262534657cc tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:36.666457 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b51522e3-b2e5-4251-aeaa-e262534657cc tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:36.667250 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b51522e3-b2e5-4251-aeaa-e262534657cc tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:36.667976 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b51522e3-b2e5-4251-aeaa-e262534657cc tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:36.669440 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b51522e3-b2e5-4251-aeaa-e262534657cc tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:36.670072 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b51522e3-b2e5-4251-aeaa-e262534657cc tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:36.670794 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b51522e3-b2e5-4251-aeaa-e262534657cc tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:36.787707 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3f050360-368d-4691-a795-181f1b67669e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:36.788642 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3f050360-368d-4691-a795-181f1b67669e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:36.796840 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f050360-368d-4691-a795-181f1b67669e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:36.797324 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f050360-368d-4691-a795-181f1b67669e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:36.797772 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f050360-368d-4691-a795-181f1b67669e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:36.798503 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f050360-368d-4691-a795-181f1b67669e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:36.798948 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f050360-368d-4691-a795-181f1b67669e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:36.799368 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f050360-368d-4691-a795-181f1b67669e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:36.867456 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b51522e3-b2e5-4251-aeaa-e262534657cc tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:36.871807 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:27:36.878419 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b51522e3-b2e5-4251-aeaa-e262534657cc tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1358 microversion: 2.1 time: 0.231090 Sep 06 21:27:36.879194 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 643/1278] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:36 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1358 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:36.945135 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3f050360-368d-4691-a795-181f1b67669e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:36.953158 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3f050360-368d-4691-a795-181f1b67669e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 200 len: 1578 microversion: 2.1 time: 0.169413 Sep 06 21:27:36.953732 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 636/1279] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:36 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 1578 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:37.471899 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-d0eae7d3-3788-4b34-b2cf-76368f563c3f req-447bee27-042f-4c27-adf7-d2828e74a585 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65014e74-e05a-4c89-ad8b-ec4bab8b9bf4", "tag": "c91372e9-966e-469c-bdfc-85d1774fc70b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:27:37.482989 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-d0eae7d3-3788-4b34-b2cf-76368f563c3f req-447bee27-042f-4c27-adf7-d2828e74a585 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:37.483698 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-d0eae7d3-3788-4b34-b2cf-76368f563c3f req-447bee27-042f-4c27-adf7-d2828e74a585 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:37.484224 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-d0eae7d3-3788-4b34-b2cf-76368f563c3f req-447bee27-042f-4c27-adf7-d2828e74a585 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:37.516770 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-d0eae7d3-3788-4b34-b2cf-76368f563c3f req-447bee27-042f-4c27-adf7-d2828e74a585 service nova] Creating event network-changed:c91372e9-966e-469c-bdfc-85d1774fc70b for instance 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 on hv-cinder-74915 Sep 06 21:27:37.521890 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-d0eae7d3-3788-4b34-b2cf-76368f563c3f req-447bee27-042f-4c27-adf7-d2828e74a585 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054597 Sep 06 21:27:37.522501 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 644/1280] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:27:37.902210 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a2838df8-f9b7-442a-8fdb-b5434d550a6a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:37.903535 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a2838df8-f9b7-442a-8fdb-b5434d550a6a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:37.911055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2838df8-f9b7-442a-8fdb-b5434d550a6a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:37.911532 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2838df8-f9b7-442a-8fdb-b5434d550a6a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:37.911978 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2838df8-f9b7-442a-8fdb-b5434d550a6a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:37.912674 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2838df8-f9b7-442a-8fdb-b5434d550a6a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:37.913299 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2838df8-f9b7-442a-8fdb-b5434d550a6a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:37.913589 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2838df8-f9b7-442a-8fdb-b5434d550a6a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:37.977801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-23dc8e74-9968-4884-a898-f85be92090ea tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:37.978470 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-23dc8e74-9968-4884-a898-f85be92090ea tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:37.985123 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23dc8e74-9968-4884-a898-f85be92090ea tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:37.985958 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23dc8e74-9968-4884-a898-f85be92090ea tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:37.986627 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23dc8e74-9968-4884-a898-f85be92090ea tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:37.987406 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23dc8e74-9968-4884-a898-f85be92090ea tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:37.988021 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23dc8e74-9968-4884-a898-f85be92090ea tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:37.988599 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-23dc8e74-9968-4884-a898-f85be92090ea tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:38.189411 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-23dc8e74-9968-4884-a898-f85be92090ea tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:38.205565 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a2838df8-f9b7-442a-8fdb-b5434d550a6a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:38.208956 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-23dc8e74-9968-4884-a898-f85be92090ea tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 200 len: 1578 microversion: 2.1 time: 0.235920 Sep 06 21:27:38.209547 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 645/1281] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:37 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 1578 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:27:38.227676 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a2838df8-f9b7-442a-8fdb-b5434d550a6a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1358 microversion: 2.1 time: 0.329395 Sep 06 21:27:38.228400 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 637/1282] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:37 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1358 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:38.554014 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-15ab5f3a-4177-4332-be2d-d8529ddc75cc req-0ebbecaa-ea24-4d2b-aa5c-3e81ef456021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4677a622-ebd6-468d-b82d-1a8b2ceae7d7", "name": "network-vif-deleted", "tag": "abdf5cae-baf0-420e-8104-fe8acf77ad2f"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:27:38.563878 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-15ab5f3a-4177-4332-be2d-d8529ddc75cc req-0ebbecaa-ea24-4d2b-aa5c-3e81ef456021 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:38.564348 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-15ab5f3a-4177-4332-be2d-d8529ddc75cc req-0ebbecaa-ea24-4d2b-aa5c-3e81ef456021 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:38.564814 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-15ab5f3a-4177-4332-be2d-d8529ddc75cc req-0ebbecaa-ea24-4d2b-aa5c-3e81ef456021 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:38.579065 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-15ab5f3a-4177-4332-be2d-d8529ddc75cc req-0ebbecaa-ea24-4d2b-aa5c-3e81ef456021 service nova] Creating event network-vif-deleted:abdf5cae-baf0-420e-8104-fe8acf77ad2f for instance 4677a622-ebd6-468d-b82d-1a8b2ceae7d7 on hv-cinder-74915 Sep 06 21:27:38.585046 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-15ab5f3a-4177-4332-be2d-d8529ddc75cc req-0ebbecaa-ea24-4d2b-aa5c-3e81ef456021 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034953 Sep 06 21:27:38.586035 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 646/1283] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:27:39.237750 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-720e0a81-aa5e-4756-a8ec-91b80aeeb89e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:39.238588 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-720e0a81-aa5e-4756-a8ec-91b80aeeb89e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:39.249714 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-720e0a81-aa5e-4756-a8ec-91b80aeeb89e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:39.250512 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-720e0a81-aa5e-4756-a8ec-91b80aeeb89e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:39.251272 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-720e0a81-aa5e-4756-a8ec-91b80aeeb89e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:39.251978 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-720e0a81-aa5e-4756-a8ec-91b80aeeb89e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:39.252430 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-720e0a81-aa5e-4756-a8ec-91b80aeeb89e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:39.252890 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-720e0a81-aa5e-4756-a8ec-91b80aeeb89e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:39.254429 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8991cce7-8ba7-48e3-8b75-44004c571503 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:39.255128 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8991cce7-8ba7-48e3-8b75-44004c571503 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:39.261662 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8991cce7-8ba7-48e3-8b75-44004c571503 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:39.262135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8991cce7-8ba7-48e3-8b75-44004c571503 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:39.262564 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8991cce7-8ba7-48e3-8b75-44004c571503 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:39.263261 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8991cce7-8ba7-48e3-8b75-44004c571503 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:39.263765 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8991cce7-8ba7-48e3-8b75-44004c571503 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:39.264175 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8991cce7-8ba7-48e3-8b75-44004c571503 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:39.316723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-720e0a81-aa5e-4756-a8ec-91b80aeeb89e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:39.325044 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-720e0a81-aa5e-4756-a8ec-91b80aeeb89e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 200 len: 1226 microversion: 2.1 time: 0.093944 Sep 06 21:27:39.325649 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 638/1284] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:39 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:39.396934 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8991cce7-8ba7-48e3-8b75-44004c571503 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:39.405211 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8991cce7-8ba7-48e3-8b75-44004c571503 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1358 microversion: 2.1 time: 0.156672 Sep 06 21:27:39.405773 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 647/1285] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:39 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:40.352489 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7dc8b830-9f88-4859-a128-8299050df50f tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:40.353735 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7dc8b830-9f88-4859-a128-8299050df50f tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:40.363624 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7dc8b830-9f88-4859-a128-8299050df50f tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:40.364132 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7dc8b830-9f88-4859-a128-8299050df50f tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:40.364634 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7dc8b830-9f88-4859-a128-8299050df50f tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:40.365439 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7dc8b830-9f88-4859-a128-8299050df50f tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:40.365869 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7dc8b830-9f88-4859-a128-8299050df50f tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:40.366351 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7dc8b830-9f88-4859-a128-8299050df50f tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:40.428756 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5c8df206-1e18-42b0-b693-71f8276fdd30 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:40.429399 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5c8df206-1e18-42b0-b693-71f8276fdd30 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:40.433771 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7dc8b830-9f88-4859-a128-8299050df50f tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:40.436940 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c8df206-1e18-42b0-b693-71f8276fdd30 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:40.437427 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c8df206-1e18-42b0-b693-71f8276fdd30 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:40.437868 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c8df206-1e18-42b0-b693-71f8276fdd30 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:40.438608 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c8df206-1e18-42b0-b693-71f8276fdd30 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:40.439055 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c8df206-1e18-42b0-b693-71f8276fdd30 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:40.439609 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c8df206-1e18-42b0-b693-71f8276fdd30 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:40.442463 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7dc8b830-9f88-4859-a128-8299050df50f tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 200 len: 1226 microversion: 2.1 time: 0.096485 Sep 06 21:27:40.443034 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 639/1286] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:40 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:40.573947 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5c8df206-1e18-42b0-b693-71f8276fdd30 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:40.583853 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5c8df206-1e18-42b0-b693-71f8276fdd30 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1358 microversion: 2.1 time: 0.159147 Sep 06 21:27:40.584436 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 648/1287] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:40 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:41.470388 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-96759830-472c-4956-a4f7-a3f1534283eb tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:41.470995 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-96759830-472c-4956-a4f7-a3f1534283eb tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:41.478242 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96759830-472c-4956-a4f7-a3f1534283eb tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:41.478791 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96759830-472c-4956-a4f7-a3f1534283eb tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:41.479241 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96759830-472c-4956-a4f7-a3f1534283eb tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:41.479975 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96759830-472c-4956-a4f7-a3f1534283eb tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:41.480449 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96759830-472c-4956-a4f7-a3f1534283eb tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:41.480937 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96759830-472c-4956-a4f7-a3f1534283eb tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:41.514924 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96759830-472c-4956-a4f7-a3f1534283eb tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:41.515549 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96759830-472c-4956-a4f7-a3f1534283eb tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:41.515988 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96759830-472c-4956-a4f7-a3f1534283eb tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:41.516428 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-96759830-472c-4956-a4f7-a3f1534283eb tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lazy-loading 'fault' on Instance uuid 4677a622-ebd6-468d-b82d-1a8b2ceae7d7 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:27:41.560484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-96759830-472c-4956-a4f7-a3f1534283eb tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0c1c510b0a4fa39927f7f92352d034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5801984f41a043daa52dbef9de89df9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:41.569421 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-96759830-472c-4956-a4f7-a3f1534283eb tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 200 len: 1231 microversion: 2.1 time: 0.105702 Sep 06 21:27:41.569977 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 640/1288] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:41 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 1231 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:41.606543 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d820de10-9221-4249-af09-cd147db4a5d9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:41.607172 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d820de10-9221-4249-af09-cd147db4a5d9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:41.614147 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d820de10-9221-4249-af09-cd147db4a5d9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:41.614638 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d820de10-9221-4249-af09-cd147db4a5d9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:41.615080 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d820de10-9221-4249-af09-cd147db4a5d9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:41.615782 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d820de10-9221-4249-af09-cd147db4a5d9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:41.616224 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d820de10-9221-4249-af09-cd147db4a5d9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:41.616646 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d820de10-9221-4249-af09-cd147db4a5d9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:41.759706 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d820de10-9221-4249-af09-cd147db4a5d9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:41.767906 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d820de10-9221-4249-af09-cd147db4a5d9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1358 microversion: 2.1 time: 0.165316 Sep 06 21:27:41.768484 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 649/1289] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:41 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:42.594203 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-117ca21b-f4fd-4ae9-8166-58b8815c17a0 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:42.595039 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-117ca21b-f4fd-4ae9-8166-58b8815c17a0 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: 4677a622-ebd6-468d-b82d-1a8b2ceae7d7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:42.602636 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-117ca21b-f4fd-4ae9-8166-58b8815c17a0 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:42.603139 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-117ca21b-f4fd-4ae9-8166-58b8815c17a0 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:42.603573 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-117ca21b-f4fd-4ae9-8166-58b8815c17a0 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:42.604269 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-117ca21b-f4fd-4ae9-8166-58b8815c17a0 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:42.604744 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-117ca21b-f4fd-4ae9-8166-58b8815c17a0 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:42.605175 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-117ca21b-f4fd-4ae9-8166-58b8815c17a0 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:42.619815 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-117ca21b-f4fd-4ae9-8166-58b8815c17a0 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] HTTP exception thrown: Instance 4677a622-ebd6-468d-b82d-1a8b2ceae7d7 could not be found. Sep 06 21:27:42.621509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-117ca21b-f4fd-4ae9-8166-58b8815c17a0 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Request method failure captured: Sep 06 21:27:42.621509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 HTTP/1.1 Sep 06 21:27:42.621509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 06 21:27:42.621509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 06 21:27:42.621509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Connection: close Sep 06 21:27:42.621509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 06 21:27:42.621509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 06 21:27:42.621509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Host: 10.222.0.79 Sep 06 21:27:42.621509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 06 21:27:42.621509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 06 21:27:42.621509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjF7jQwuYbSnhwsURE38g_NHxq8bkKeKTGiasuG8R4J_ohgqXTkmcNemP-pvRgIf7MR28ChWbVjrUwIwrlbvTaNHxgEiRZjVhDAuiU5kjaT_8n44UF6j6b14JfeGTZ8SassSWNa8C9Bt9GxMa4yojoeSluWQiZXZE308nZw0eafQVQ1xg Sep 06 21:27:42.621509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 06 21:27:42.621509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 06 21:27:42.621509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 06 21:27:42.621509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 06 21:27:42.621509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 06 21:27:42.621509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 06 21:27:42.621509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Id: 5801984f41a043daa52dbef9de89df9a Sep 06 21:27:42.621509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-TestVolumeBootPattern-1838133913 Sep 06 21:27:42.621509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Role: reader,member Sep 06 21:27:42.621509 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Sep 06 21:27:42.623417 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5801984f41a043daa52dbef9de89df9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5801984f41a043daa52dbef9de89df9a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5801984f41a043daa52dbef9de89df9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5801984f41a043daa52dbef9de89df9a"}]}] Sep 06 21:27:42.623417 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-TestVolumeBootPattern-1838133913 Sep 06 21:27:42.623417 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 5801984f41a043daa52dbef9de89df9a Sep 06 21:27:42.623417 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestVolumeBootPattern-1838133913 Sep 06 21:27:42.623417 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User: tempest-TestVolumeBootPattern-1838133913-project Sep 06 21:27:42.623417 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 06 21:27:42.623417 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 06 21:27:42.623417 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Id: 6d0c1c510b0a4fa39927f7f92352d034 Sep 06 21:27:42.623417 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-TestVolumeBootPattern-1838133913-project Sep 06 21:27:42.623417 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: method: > Sep 06 21:27:42.623417 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: exception: Instance 4677a622-ebd6-468d-b82d-1a8b2ceae7d7 could not be found. Sep 06 21:27:42.623417 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: action_args: {'id': '4677a622-ebd6-468d-b82d-1a8b2ceae7d7'} Sep 06 21:27:42.624629 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:27:42.624629 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:27:42.624629 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:27:42.624629 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:27:42.624629 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:27:42.624629 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:27:42.624629 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:27:42.624629 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:27:42.624629 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:27:42.624629 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:27:42.624629 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4677a622-ebd6-468d-b82d-1a8b2ceae7d7 could not be found. Sep 06 21:27:42.624629 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:27:42.624629 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:27:42.624629 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:27:42.624629 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:27:42.624629 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:27:42.624629 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:27:42.624629 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:27:42.624629 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:27:42.624629 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:27:42.626353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:27:42.626353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:27:42.626353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:27:42.626353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:27:42.626353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:27:42.626353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:27:42.626353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:27:42.626353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4677a622-ebd6-468d-b82d-1a8b2ceae7d7 could not be found. Sep 06 21:27:42.626353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:27:42.626353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:27:42.626353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:27:42.626353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:27:42.626353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:27:42.626353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:27:42.626353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:27:42.626353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:27:42.626353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4677a622-ebd6-468d-b82d-1a8b2ceae7d7 could not be found. Sep 06 21:27:42.626353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:27:42.628004 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-117ca21b-f4fd-4ae9-8166-58b8815c17a0 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Returning 404 to user: Instance 4677a622-ebd6-468d-b82d-1a8b2ceae7d7 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:27:42.628004 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-117ca21b-f4fd-4ae9-8166-58b8815c17a0 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7" status: 404 len: 111 microversion: 2.1 time: 0.032779 Sep 06 21:27:42.628004 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 641/1290] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:42 2022] GET /compute/v2.1/servers/4677a622-ebd6-468d-b82d-1a8b2ceae7d7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:27:42.791446 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5959b8b5-a4bc-46db-9cdf-a1b965f602f6 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:42.792156 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5959b8b5-a4bc-46db-9cdf-a1b965f602f6 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:42.799425 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5959b8b5-a4bc-46db-9cdf-a1b965f602f6 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:42.799886 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5959b8b5-a4bc-46db-9cdf-a1b965f602f6 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:42.800351 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5959b8b5-a4bc-46db-9cdf-a1b965f602f6 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:42.801096 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5959b8b5-a4bc-46db-9cdf-a1b965f602f6 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:42.801545 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5959b8b5-a4bc-46db-9cdf-a1b965f602f6 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:42.801968 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5959b8b5-a4bc-46db-9cdf-a1b965f602f6 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:42.996946 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5959b8b5-a4bc-46db-9cdf-a1b965f602f6 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:43.007623 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5959b8b5-a4bc-46db-9cdf-a1b965f602f6 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1358 microversion: 2.1 time: 0.220358 Sep 06 21:27:43.008274 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 650/1291] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:42 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:43.169065 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f83ccc5b-1ea3-4a39-b541-ea763421b14c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:43.169556 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f83ccc5b-1ea3-4a39-b541-ea763421b14c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:43.176173 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f83ccc5b-1ea3-4a39-b541-ea763421b14c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:43.176617 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f83ccc5b-1ea3-4a39-b541-ea763421b14c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:43.177067 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f83ccc5b-1ea3-4a39-b541-ea763421b14c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:43.177773 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f83ccc5b-1ea3-4a39-b541-ea763421b14c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:43.178201 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f83ccc5b-1ea3-4a39-b541-ea763421b14c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:43.178617 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f83ccc5b-1ea3-4a39-b541-ea763421b14c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:43.192143 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-f83ccc5b-1ea3-4a39-b541-ea763421b14c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] HTTP exception thrown: Instance a8d6fc21-502d-41ec-8216-29ad57153010 could not be found. Sep 06 21:27:43.193706 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f83ccc5b-1ea3-4a39-b541-ea763421b14c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Request method failure captured: Sep 06 21:27:43.193706 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 HTTP/1.1 Sep 06 21:27:43.193706 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 06 21:27:43.193706 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 06 21:27:43.193706 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Connection: close Sep 06 21:27:43.193706 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 06 21:27:43.193706 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 06 21:27:43.193706 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Host: 10.222.0.79 Sep 06 21:27:43.193706 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 06 21:27:43.193706 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 06 21:27:43.193706 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjF7jQwuYbSnhwsURE38g_NHxq8bkKeKTGiasuG8R4J_ohgqXTkmcNemP-pvRgIf7MR28ChWbVjrUwIwrlbvTaNHxgEiRZjVhDAuiU5kjaT_8n44UF6j6b14JfeGTZ8SassSWNa8C9Bt9GxMa4yojoeSluWQiZXZE308nZw0eafQVQ1xg Sep 06 21:27:43.193706 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 06 21:27:43.193706 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 06 21:27:43.193706 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 06 21:27:43.193706 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 06 21:27:43.193706 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 06 21:27:43.193706 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 06 21:27:43.193706 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Id: 5801984f41a043daa52dbef9de89df9a Sep 06 21:27:43.193706 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-TestVolumeBootPattern-1838133913 Sep 06 21:27:43.193706 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Role: reader,member Sep 06 21:27:43.193706 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Sep 06 21:27:43.195478 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5801984f41a043daa52dbef9de89df9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5801984f41a043daa52dbef9de89df9a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5801984f41a043daa52dbef9de89df9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5801984f41a043daa52dbef9de89df9a"}]}] Sep 06 21:27:43.195478 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-TestVolumeBootPattern-1838133913 Sep 06 21:27:43.195478 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 5801984f41a043daa52dbef9de89df9a Sep 06 21:27:43.195478 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestVolumeBootPattern-1838133913 Sep 06 21:27:43.195478 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User: tempest-TestVolumeBootPattern-1838133913-project Sep 06 21:27:43.195478 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 06 21:27:43.195478 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 06 21:27:43.195478 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Id: 6d0c1c510b0a4fa39927f7f92352d034 Sep 06 21:27:43.195478 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-TestVolumeBootPattern-1838133913-project Sep 06 21:27:43.195478 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: method: > Sep 06 21:27:43.195478 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: exception: Instance a8d6fc21-502d-41ec-8216-29ad57153010 could not be found. Sep 06 21:27:43.195478 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: action_args: {'id': 'a8d6fc21-502d-41ec-8216-29ad57153010'} Sep 06 21:27:43.196537 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:27:43.196537 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:27:43.196537 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:27:43.196537 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:27:43.196537 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:27:43.196537 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:27:43.196537 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:27:43.196537 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:27:43.196537 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:27:43.196537 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:27:43.196537 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8d6fc21-502d-41ec-8216-29ad57153010 could not be found. Sep 06 21:27:43.196537 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:27:43.196537 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:27:43.196537 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:27:43.196537 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:27:43.196537 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:27:43.196537 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:27:43.196537 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:27:43.196537 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:27:43.196537 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:27:43.198278 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:27:43.198278 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 21:27:43.198278 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 21:27:43.198278 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 21:27:43.198278 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 21:27:43.198278 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:27:43.198278 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:27:43.198278 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:27:43.198278 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:27:43.198278 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8d6fc21-502d-41ec-8216-29ad57153010 could not be found. Sep 06 21:27:43.198278 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:27:43.198278 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:27:43.198278 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:27:43.198278 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:27:43.198278 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:27:43.198278 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:27:43.198278 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:27:43.198278 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:27:43.198278 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8d6fc21-502d-41ec-8216-29ad57153010 could not be found. Sep 06 21:27:43.198278 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:27:43.199748 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f83ccc5b-1ea3-4a39-b541-ea763421b14c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Returning 404 to user: Instance a8d6fc21-502d-41ec-8216-29ad57153010 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:27:43.199748 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f83ccc5b-1ea3-4a39-b541-ea763421b14c tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 404 len: 111 microversion: 2.1 time: 0.030429 Sep 06 21:27:43.199748 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 642/1292] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Sep 6 21:27:43 2022] DELETE /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:27:43.204221 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9b563682-594d-454f-9bf1-6677f911e595 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:43.204955 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9b563682-594d-454f-9bf1-6677f911e595 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] [instance: a8d6fc21-502d-41ec-8216-29ad57153010] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:43.211067 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b563682-594d-454f-9bf1-6677f911e595 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:43.211537 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b563682-594d-454f-9bf1-6677f911e595 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:43.211964 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b563682-594d-454f-9bf1-6677f911e595 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:43.212681 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b563682-594d-454f-9bf1-6677f911e595 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:43.213115 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b563682-594d-454f-9bf1-6677f911e595 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:43.213531 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b563682-594d-454f-9bf1-6677f911e595 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:43.227379 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-9b563682-594d-454f-9bf1-6677f911e595 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] HTTP exception thrown: Instance a8d6fc21-502d-41ec-8216-29ad57153010 could not be found. Sep 06 21:27:43.229076 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9b563682-594d-454f-9bf1-6677f911e595 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Request method failure captured: Sep 06 21:27:43.229076 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 HTTP/1.1 Sep 06 21:27:43.229076 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:27:43.229076 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:27:43.229076 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:27:43.229076 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:27:43.229076 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:27:43.229076 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:27:43.229076 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:27:43.229076 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:27:43.229076 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7jQwuYbSnhwsURE38g_NHxq8bkKeKTGiasuG8R4J_ohgqXTkmcNemP-pvRgIf7MR28ChWbVjrUwIwrlbvTaNHxgEiRZjVhDAuiU5kjaT_8n44UF6j6b14JfeGTZ8SassSWNa8C9Bt9GxMa4yojoeSluWQiZXZE308nZw0eafQVQ1xg Sep 06 21:27:43.229076 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:27:43.229076 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:27:43.229076 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:27:43.229076 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:27:43.229076 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:27:43.229076 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:27:43.229076 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: 5801984f41a043daa52dbef9de89df9a Sep 06 21:27:43.229076 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-TestVolumeBootPattern-1838133913 Sep 06 21:27:43.229076 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:27:43.229076 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:27:43.230730 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5801984f41a043daa52dbef9de89df9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5801984f41a043daa52dbef9de89df9a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5801984f41a043daa52dbef9de89df9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5801984f41a043daa52dbef9de89df9a"}]}] Sep 06 21:27:43.230730 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-TestVolumeBootPattern-1838133913 Sep 06 21:27:43.230730 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 5801984f41a043daa52dbef9de89df9a Sep 06 21:27:43.230730 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestVolumeBootPattern-1838133913 Sep 06 21:27:43.230730 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-TestVolumeBootPattern-1838133913-project Sep 06 21:27:43.230730 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:27:43.230730 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:27:43.230730 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: 6d0c1c510b0a4fa39927f7f92352d034 Sep 06 21:27:43.230730 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-TestVolumeBootPattern-1838133913-project Sep 06 21:27:43.230730 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: > Sep 06 21:27:43.230730 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Instance a8d6fc21-502d-41ec-8216-29ad57153010 could not be found. Sep 06 21:27:43.230730 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'id': 'a8d6fc21-502d-41ec-8216-29ad57153010'} Sep 06 21:27:43.231622 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:27:43.231622 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:27:43.231622 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:27:43.231622 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:27:43.231622 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:27:43.231622 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:27:43.231622 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:27:43.231622 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:27:43.231622 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:27:43.231622 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:27:43.231622 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8d6fc21-502d-41ec-8216-29ad57153010 could not be found. Sep 06 21:27:43.231622 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:27:43.231622 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:27:43.231622 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:27:43.231622 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:27:43.231622 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:27:43.231622 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:27:43.231622 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:27:43.231622 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:27:43.231622 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:27:43.233081 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:27:43.233081 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:27:43.233081 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:27:43.233081 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:27:43.233081 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:27:43.233081 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:27:43.233081 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:27:43.233081 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8d6fc21-502d-41ec-8216-29ad57153010 could not be found. Sep 06 21:27:43.233081 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:27:43.233081 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:27:43.233081 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:27:43.233081 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:27:43.233081 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:27:43.233081 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:27:43.233081 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:27:43.233081 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:27:43.233081 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8d6fc21-502d-41ec-8216-29ad57153010 could not be found. Sep 06 21:27:43.233081 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:27:43.234294 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9b563682-594d-454f-9bf1-6677f911e595 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Returning 404 to user: Instance a8d6fc21-502d-41ec-8216-29ad57153010 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:27:43.234294 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9b563682-594d-454f-9bf1-6677f911e595 tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010" status: 404 len: 111 microversion: 2.1 time: 0.030166 Sep 06 21:27:43.234294 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 651/1293] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:43 2022] GET /compute/v2.1/servers/a8d6fc21-502d-41ec-8216-29ad57153010 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:27:44.030194 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-570af410-27a7-46c4-81ce-e2a261aec0f2 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:44.030804 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-570af410-27a7-46c4-81ce-e2a261aec0f2 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:44.032703 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-eeb17d98-568d-4614-85ef-1d956bed958d req-cc532a42-9472-4f36-a4d1-d4f5325827dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65014e74-e05a-4c89-ad8b-ec4bab8b9bf4", "name": "network-vif-plugged", "status": "completed", "tag": "c91372e9-966e-469c-bdfc-85d1774fc70b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:27:44.037652 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-570af410-27a7-46c4-81ce-e2a261aec0f2 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:44.038141 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-570af410-27a7-46c4-81ce-e2a261aec0f2 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:44.038577 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-570af410-27a7-46c4-81ce-e2a261aec0f2 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:44.039335 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-570af410-27a7-46c4-81ce-e2a261aec0f2 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:44.039818 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-570af410-27a7-46c4-81ce-e2a261aec0f2 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:44.040617 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-570af410-27a7-46c4-81ce-e2a261aec0f2 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:44.047519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-eeb17d98-568d-4614-85ef-1d956bed958d req-cc532a42-9472-4f36-a4d1-d4f5325827dd service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:44.047996 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-eeb17d98-568d-4614-85ef-1d956bed958d req-cc532a42-9472-4f36-a4d1-d4f5325827dd service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:44.048430 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-eeb17d98-568d-4614-85ef-1d956bed958d req-cc532a42-9472-4f36-a4d1-d4f5325827dd service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:44.060819 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-eeb17d98-568d-4614-85ef-1d956bed958d req-cc532a42-9472-4f36-a4d1-d4f5325827dd service nova] Creating event network-vif-plugged:c91372e9-966e-469c-bdfc-85d1774fc70b for instance 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 on hv-cinder-74915 Sep 06 21:27:44.066620 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-eeb17d98-568d-4614-85ef-1d956bed958d req-cc532a42-9472-4f36-a4d1-d4f5325827dd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037504 Sep 06 21:27:44.067224 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 652/1294] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:27:44.175978 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-570af410-27a7-46c4-81ce-e2a261aec0f2 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:44.183776 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-570af410-27a7-46c4-81ce-e2a261aec0f2 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1358 microversion: 2.1 time: 0.157652 Sep 06 21:27:44.184343 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 643/1295] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:44 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:44.572536 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-579c3ff1-1c64-4131-abc6-102b236d305e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] Calling method '.version_select at 0x7f04ce69c040>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:44.600517 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-579c3ff1-1c64-4131-abc6-102b236d305e tempest-TestVolumeBootPattern-1838133913 tempest-TestVolumeBootPattern-1838133913-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1275668507" status: 202 len: 0 microversion: 2.1 time: 0.032282 Sep 06 21:27:44.601200 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 653/1296] 10.222.0.79 () {58 vars in 1263 bytes} [Tue Sep 6 21:27:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1275668507 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:27:45.207003 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-61a9ff1b-f398-4c0e-8301-3cdd5276b49c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:45.207597 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-61a9ff1b-f398-4c0e-8301-3cdd5276b49c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:45.215057 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61a9ff1b-f398-4c0e-8301-3cdd5276b49c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:45.215531 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61a9ff1b-f398-4c0e-8301-3cdd5276b49c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:45.215951 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61a9ff1b-f398-4c0e-8301-3cdd5276b49c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:45.216640 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61a9ff1b-f398-4c0e-8301-3cdd5276b49c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:45.217109 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61a9ff1b-f398-4c0e-8301-3cdd5276b49c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:45.217529 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61a9ff1b-f398-4c0e-8301-3cdd5276b49c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:45.353715 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-61a9ff1b-f398-4c0e-8301-3cdd5276b49c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:45.361810 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-61a9ff1b-f398-4c0e-8301-3cdd5276b49c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1358 microversion: 2.1 time: 0.158848 Sep 06 21:27:45.362427 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 644/1297] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:45 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:46.389054 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-12d70bca-406f-4005-8f15-7ddeaf42b0f1 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:46.390214 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-12d70bca-406f-4005-8f15-7ddeaf42b0f1 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:46.394372 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:27:46.402197 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12d70bca-406f-4005-8f15-7ddeaf42b0f1 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:46.402864 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12d70bca-406f-4005-8f15-7ddeaf42b0f1 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:46.403396 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12d70bca-406f-4005-8f15-7ddeaf42b0f1 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:46.404230 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12d70bca-406f-4005-8f15-7ddeaf42b0f1 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:46.404808 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12d70bca-406f-4005-8f15-7ddeaf42b0f1 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:46.405324 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12d70bca-406f-4005-8f15-7ddeaf42b0f1 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:46.756260 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-12d70bca-406f-4005-8f15-7ddeaf42b0f1 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:46.764546 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-12d70bca-406f-4005-8f15-7ddeaf42b0f1 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1548 microversion: 2.1 time: 0.380897 Sep 06 21:27:46.765373 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 654/1298] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:46 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1548 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:46.788759 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d26188c8-585f-43fb-bf83-eab2391e6126 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:46.790739 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d26188c8-585f-43fb-bf83-eab2391e6126 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:46.795214 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:27:46.799236 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d26188c8-585f-43fb-bf83-eab2391e6126 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:46.799866 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d26188c8-585f-43fb-bf83-eab2391e6126 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:46.800372 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d26188c8-585f-43fb-bf83-eab2391e6126 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:46.801334 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d26188c8-585f-43fb-bf83-eab2391e6126 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:46.802000 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d26188c8-585f-43fb-bf83-eab2391e6126 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:46.802658 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d26188c8-585f-43fb-bf83-eab2391e6126 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:46.949346 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d26188c8-585f-43fb-bf83-eab2391e6126 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:46.958997 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d26188c8-585f-43fb-bf83-eab2391e6126 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1548 microversion: 2.1 time: 0.175465 Sep 06 21:27:46.960177 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 645/1299] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:46 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1548 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:46.984908 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8c49cc25-8326-419c-b8f5-3e2308ce1eb6 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:46.991272 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8c49cc25-8326-419c-b8f5-3e2308ce1eb6 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:46.992188 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8c49cc25-8326-419c-b8f5-3e2308ce1eb6 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Searching by: {'deleted': False, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e'} {{(pid=120719) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 21:27:46.999586 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c49cc25-8326-419c-b8f5-3e2308ce1eb6 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:47.000181 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c49cc25-8326-419c-b8f5-3e2308ce1eb6 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:47.000749 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c49cc25-8326-419c-b8f5-3e2308ce1eb6 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:47.001583 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c49cc25-8326-419c-b8f5-3e2308ce1eb6 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:47.002224 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c49cc25-8326-419c-b8f5-3e2308ce1eb6 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:47.002705 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c49cc25-8326-419c-b8f5-3e2308ce1eb6 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:47.098351 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.multi_cell_list [None req-8c49cc25-8326-419c-b8f5-3e2308ce1eb6 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120719) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 21:27:47.195936 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8c49cc25-8326-419c-b8f5-3e2308ce1eb6 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.215136 Sep 06 21:27:47.196537 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 655/1300] 10.222.0.79 () {58 vars in 1125 bytes} [Tue Sep 6 21:27:46 2022] GET /compute/v2.1/servers => generated 342 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:27:47.211406 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-047961a8-9342-4b5d-bd8a-90ee37824827 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:47.211999 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-047961a8-9342-4b5d-bd8a-90ee37824827 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:47.218336 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-047961a8-9342-4b5d-bd8a-90ee37824827 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:47.218811 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-047961a8-9342-4b5d-bd8a-90ee37824827 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:47.219236 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-047961a8-9342-4b5d-bd8a-90ee37824827 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:47.219925 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-047961a8-9342-4b5d-bd8a-90ee37824827 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:47.220367 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-047961a8-9342-4b5d-bd8a-90ee37824827 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:47.220815 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-047961a8-9342-4b5d-bd8a-90ee37824827 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:47.354171 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-047961a8-9342-4b5d-bd8a-90ee37824827 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:47.362345 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-047961a8-9342-4b5d-bd8a-90ee37824827 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1548 microversion: 2.1 time: 0.154998 Sep 06 21:27:47.362926 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 646/1301] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:47 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:48.973514 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5d01b4de-acbd-4fc6-8526-b388e727413e tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "601755c2-67ab-4a32-aa7e-5f32adf15a2f"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:27:48.975817 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5d01b4de-acbd-4fc6-8526-b388e727413e tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:48.983145 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d01b4de-acbd-4fc6-8526-b388e727413e tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:48.983619 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d01b4de-acbd-4fc6-8526-b388e727413e tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:48.984045 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d01b4de-acbd-4fc6-8526-b388e727413e tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:48.984773 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d01b4de-acbd-4fc6-8526-b388e727413e tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:48.985217 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d01b4de-acbd-4fc6-8526-b388e727413e tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:48.985630 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5d01b4de-acbd-4fc6-8526-b388e727413e tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:49.300162 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5d01b4de-acbd-4fc6-8526-b388e727413e tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "POST /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.330498 Sep 06 21:27:49.301114 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 656/1302] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Sep 6 21:27:48 2022] POST /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4/os-volume_attachments => generated 194 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:27:56.991857 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f736e854-386f-4a2a-83a6-df3cb8ab8dbc tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:27:56.993067 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f736e854-386f-4a2a-83a6-df3cb8ab8dbc tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:27:57.001743 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f736e854-386f-4a2a-83a6-df3cb8ab8dbc tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:57.002227 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f736e854-386f-4a2a-83a6-df3cb8ab8dbc tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:57.002780 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f736e854-386f-4a2a-83a6-df3cb8ab8dbc tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:57.003485 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f736e854-386f-4a2a-83a6-df3cb8ab8dbc tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:57.003963 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f736e854-386f-4a2a-83a6-df3cb8ab8dbc tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:57.004497 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f736e854-386f-4a2a-83a6-df3cb8ab8dbc tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:57.156978 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f736e854-386f-4a2a-83a6-df3cb8ab8dbc tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:27:57.166286 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f736e854-386f-4a2a-83a6-df3cb8ab8dbc tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1594 microversion: 2.1 time: 0.180110 Sep 06 21:27:57.166832 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 647/1303] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:27:56 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1594 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:27:59.049486 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:27:59.050270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=5 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:27:59.054659 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-1f58318d-9ecf-4e20-951e-b379f54dfab4 req-3633b602-bc60-4523-ad08-2458223de769 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65014e74-e05a-4c89-ad8b-ec4bab8b9bf4", "tag": "c91372e9-966e-469c-bdfc-85d1774fc70b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:27:59.065260 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1f58318d-9ecf-4e20-951e-b379f54dfab4 req-3633b602-bc60-4523-ad08-2458223de769 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:27:59.065685 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1f58318d-9ecf-4e20-951e-b379f54dfab4 req-3633b602-bc60-4523-ad08-2458223de769 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:27:59.066171 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1f58318d-9ecf-4e20-951e-b379f54dfab4 req-3633b602-bc60-4523-ad08-2458223de769 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:27:59.078890 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-1f58318d-9ecf-4e20-951e-b379f54dfab4 req-3633b602-bc60-4523-ad08-2458223de769 service nova] Creating event network-changed:c91372e9-966e-469c-bdfc-85d1774fc70b for instance 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 on hv-cinder-74915 Sep 06 21:27:59.084331 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-1f58318d-9ecf-4e20-951e-b379f54dfab4 req-3633b602-bc60-4523-ad08-2458223de769 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036288 Sep 06 21:27:59.085192 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 657/1304] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:28:00.168906 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f7cfd997-4b97-4582-a11c-a68a05d33ee9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1882548395"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:28:00.169648 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f7cfd997-4b97-4582-a11c-a68a05d33ee9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:28:00.176385 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7cfd997-4b97-4582-a11c-a68a05d33ee9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:00.176834 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7cfd997-4b97-4582-a11c-a68a05d33ee9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:00.177266 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7cfd997-4b97-4582-a11c-a68a05d33ee9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:00.178185 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7cfd997-4b97-4582-a11c-a68a05d33ee9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:00.178826 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7cfd997-4b97-4582-a11c-a68a05d33ee9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:00.179211 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7cfd997-4b97-4582-a11c-a68a05d33ee9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:00.312503 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.network.security_group_api [None req-f7cfd997-4b97-4582-a11c-a68a05d33ee9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Adding security group 74c53134-723a-49c7-89eb-057a149e1018 to port c91372e9-966e-469c-bdfc-85d1774fc70b Sep 06 21:28:00.646347 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f7cfd997-4b97-4582-a11c-a68a05d33ee9 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "POST /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4/action" status: 202 len: 0 microversion: 2.1 time: 0.481998 Sep 06 21:28:00.656044 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-147d91f0-30b3-42bd-a0a0-289a68d12849 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:28:00.656740 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 648/1305] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Sep 6 21:28:00 2022] POST /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:28:00.657015 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-147d91f0-30b3-42bd-a0a0-289a68d12849 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:28:00.664323 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-147d91f0-30b3-42bd-a0a0-289a68d12849 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:00.665231 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-147d91f0-30b3-42bd-a0a0-289a68d12849 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:00.665635 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-147d91f0-30b3-42bd-a0a0-289a68d12849 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:00.666616 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-147d91f0-30b3-42bd-a0a0-289a68d12849 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:00.667016 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-147d91f0-30b3-42bd-a0a0-289a68d12849 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:00.667438 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-147d91f0-30b3-42bd-a0a0-289a68d12849 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:00.910759 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-147d91f0-30b3-42bd-a0a0-289a68d12849 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:28:00.933270 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-147d91f0-30b3-42bd-a0a0-289a68d12849 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1759 microversion: 2.1 time: 0.281272 Sep 06 21:28:00.933862 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 658/1306] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:28:00 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1759 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:28:01.101539 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-17592e76-465a-46c5-92a3-d98bbce5df12 req-32e10bcd-d5ed-44fc-a814-b350d0a36f00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65014e74-e05a-4c89-ad8b-ec4bab8b9bf4", "tag": "c91372e9-966e-469c-bdfc-85d1774fc70b"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:28:01.112192 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-17592e76-465a-46c5-92a3-d98bbce5df12 req-32e10bcd-d5ed-44fc-a814-b350d0a36f00 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:01.112632 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-17592e76-465a-46c5-92a3-d98bbce5df12 req-32e10bcd-d5ed-44fc-a814-b350d0a36f00 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:01.113349 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-17592e76-465a-46c5-92a3-d98bbce5df12 req-32e10bcd-d5ed-44fc-a814-b350d0a36f00 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:01.125918 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-17592e76-465a-46c5-92a3-d98bbce5df12 req-32e10bcd-d5ed-44fc-a814-b350d0a36f00 service nova] Creating event network-changed:c91372e9-966e-469c-bdfc-85d1774fc70b for instance 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 on hv-cinder-74915 Sep 06 21:28:01.131218 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-17592e76-465a-46c5-92a3-d98bbce5df12 req-32e10bcd-d5ed-44fc-a814-b350d0a36f00 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033813 Sep 06 21:28:01.131832 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 649/1307] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:28:17.962829 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:17.963496 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:18.129527 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7bdda648-b326-456f-85bf-66d2fd7f8a43 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:28:18.130028 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7bdda648-b326-456f-85bf-66d2fd7f8a43 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:28:18.136519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bdda648-b326-456f-85bf-66d2fd7f8a43 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:18.137034 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bdda648-b326-456f-85bf-66d2fd7f8a43 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:18.137472 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bdda648-b326-456f-85bf-66d2fd7f8a43 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:18.138180 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bdda648-b326-456f-85bf-66d2fd7f8a43 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:18.138622 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bdda648-b326-456f-85bf-66d2fd7f8a43 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:18.139049 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7bdda648-b326-456f-85bf-66d2fd7f8a43 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:18.162310 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7bdda648-b326-456f-85bf-66d2fd7f8a43 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a/ips" status: 200 len: 149 microversion: 2.1 time: 0.207208 Sep 06 21:28:18.162857 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 659/1308] 10.222.0.79 () {58 vars in 1248 bytes} [Tue Sep 6 21:28:17 2022] GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a/ips => generated 149 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:28:19.559933 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=9 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:19.560691 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=78 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:19.564916 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6b5e1493-8918-4922-a026-7fbbd144a790 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d98e124-4cf0-4990-81ac-1fd1c13ffd0d"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:28:19.567343 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6b5e1493-8918-4922-a026-7fbbd144a790 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:28:19.574346 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b5e1493-8918-4922-a026-7fbbd144a790 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:19.574828 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b5e1493-8918-4922-a026-7fbbd144a790 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:19.575249 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b5e1493-8918-4922-a026-7fbbd144a790 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:19.575921 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b5e1493-8918-4922-a026-7fbbd144a790 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:19.576361 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b5e1493-8918-4922-a026-7fbbd144a790 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:19.576803 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b5e1493-8918-4922-a026-7fbbd144a790 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:19.867005 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6b5e1493-8918-4922-a026-7fbbd144a790 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "POST /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307996 Sep 06 21:28:19.867521 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 650/1309] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Sep 6 21:28:19 2022] POST /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:28:27.463423 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ce2225ae-ec8c-4690-8bc8-321c604a143a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d98e124-4cf0-4990-81ac-1fd1c13ffd0d"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:28:27.465912 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ce2225ae-ec8c-4690-8bc8-321c604a143a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:28:27.472506 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce2225ae-ec8c-4690-8bc8-321c604a143a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:27.473015 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce2225ae-ec8c-4690-8bc8-321c604a143a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:27.473451 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce2225ae-ec8c-4690-8bc8-321c604a143a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:27.474143 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce2225ae-ec8c-4690-8bc8-321c604a143a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:27.474593 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce2225ae-ec8c-4690-8bc8-321c604a143a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:27.475007 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce2225ae-ec8c-4690-8bc8-321c604a143a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:27.557731 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-ce2225ae-ec8c-4690-8bc8-321c604a143a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] HTTP exception thrown: Invalid volume: volume 9d98e124-4cf0-4990-81ac-1fd1c13ffd0d is already attached to instances: 03eaf3bf-fadc-452d-97c1-7faa2414a36a Sep 06 21:28:27.559490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ce2225ae-ec8c-4690-8bc8-321c604a143a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Request method failure captured: Sep 06 21:28:27.559490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: POST /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a/os-volume_attachments HTTP/1.1 Sep 06 21:28:27.559490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:28:27.559490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:28:27.559490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:28:27.559490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 74 Sep 06 21:28:27.559490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:28:27.559490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:28:27.559490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:28:27.559490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:28:27.559490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7oBRUaWFmUaRMRrY2lmG27XTCe8m7oOenu15JckXMhNFYDIb6s6CTPHxEIINys886U3nqIXNvhOhvtXDn-W2TtU1LkNmSf6teGC7l2Pr1U-HL4_5PeX8X3jMoeu0l-wC_3RYNggU9GitVP5pFTsCQ7cQZQ9cQw1uf_6XEJXvRawCjA Sep 06 21:28:27.559490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:28:27.559490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:28:27.559490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:28:27.559490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:28:27.559490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:28:27.559490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:28:27.559490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: 0ca0b63bd9224370b45e7cc5e9c68a27 Sep 06 21:28:27.559490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:28:27.559490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:28:27.559490 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:28:27.561223 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0ca0b63bd9224370b45e7cc5e9c68a27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0ca0b63bd9224370b45e7cc5e9c68a27", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ca0b63bd9224370b45e7cc5e9c68a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ca0b63bd9224370b45e7cc5e9c68a27"}]}] Sep 06 21:28:27.561223 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:28:27.561223 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 0ca0b63bd9224370b45e7cc5e9c68a27 Sep 06 21:28:27.561223 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:28:27.561223 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeNegativeTest-1682827976-project Sep 06 21:28:27.561223 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:28:27.561223 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:28:27.561223 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: e22472efcb9a454688744457cb45eabb Sep 06 21:28:27.561223 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeNegativeTest-1682827976-project Sep 06 21:28:27.561223 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Sep 06 21:28:27.561223 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {"volumeAttachment": {"volumeId": "9d98e124-4cf0-4990-81ac-1fd1c13ffd0d"}} Sep 06 21:28:27.561223 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: > Sep 06 21:28:27.563031 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Invalid volume: volume 9d98e124-4cf0-4990-81ac-1fd1c13ffd0d is already attached to instances: 03eaf3bf-fadc-452d-97c1-7faa2414a36a Sep 06 21:28:27.563031 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'server_id': '03eaf3bf-fadc-452d-97c1-7faa2414a36a', 'body': {'volumeAttachment': {'volumeId': '9d98e124-4cf0-4990-81ac-1fd1c13ffd0d'}}} Sep 06 21:28:27.563031 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:28:27.563031 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:28:27.563031 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 06 21:28:27.563031 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 06 21:28:27.563031 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 21:28:27.563031 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 21:28:27.563031 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 06 21:28:27.563031 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 21:28:27.563031 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 06 21:28:27.563031 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 06 21:28:27.563031 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 06 21:28:27.563031 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 06 21:28:27.563031 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9d98e124-4cf0-4990-81ac-1fd1c13ffd0d is already attached to instances: 03eaf3bf-fadc-452d-97c1-7faa2414a36a Sep 06 21:28:27.563031 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:28:27.563031 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:28:27.563031 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:28:27.563031 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:28:27.564401 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:28:27.564401 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:28:27.564401 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:28:27.564401 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:28:27.564401 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:28:27.564401 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:28:27.564401 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 21:28:27.564401 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 21:28:27.564401 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 21:28:27.564401 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 21:28:27.564401 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 21:28:27.564401 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 21:28:27.564401 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 06 21:28:27.564401 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 06 21:28:27.564401 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9d98e124-4cf0-4990-81ac-1fd1c13ffd0d is already attached to instances: 03eaf3bf-fadc-452d-97c1-7faa2414a36a Sep 06 21:28:27.564401 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:28:27.564401 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:28:27.564401 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:28:27.564401 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:28:27.564401 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:28:27.565903 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:28:27.565903 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:28:27.565903 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:28:27.565903 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9d98e124-4cf0-4990-81ac-1fd1c13ffd0d is already attached to instances: 03eaf3bf-fadc-452d-97c1-7faa2414a36a Sep 06 21:28:27.565903 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:28:27.565903 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ce2225ae-ec8c-4690-8bc8-321c604a143a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Returning 400 to user: Invalid volume: volume 9d98e124-4cf0-4990-81ac-1fd1c13ffd0d is already attached to instances: 03eaf3bf-fadc-452d-97c1-7faa2414a36a {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:28:27.565903 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ce2225ae-ec8c-4690-8bc8-321c604a143a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "POST /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101544 Sep 06 21:28:27.565903 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 660/1310] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Sep 6 21:28:27 2022] POST /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 21:28:27.639970 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b78ab871-91c0-44fa-ba7a-185c11c8b2f2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:28:27.640495 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b78ab871-91c0-44fa-ba7a-185c11c8b2f2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:28:27.647670 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b78ab871-91c0-44fa-ba7a-185c11c8b2f2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:27.648171 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b78ab871-91c0-44fa-ba7a-185c11c8b2f2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:27.648568 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b78ab871-91c0-44fa-ba7a-185c11c8b2f2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:27.649363 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b78ab871-91c0-44fa-ba7a-185c11c8b2f2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:27.649800 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b78ab871-91c0-44fa-ba7a-185c11c8b2f2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:27.650208 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b78ab871-91c0-44fa-ba7a-185c11c8b2f2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:27.746399 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-b78ab871-91c0-44fa-ba7a-185c11c8b2f2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lazy-loading 'services' on Instance uuid 03eaf3bf-fadc-452d-97c1-7faa2414a36a {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:28:27.834941 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b78ab871-91c0-44fa-ba7a-185c11c8b2f2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "DELETE /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a/os-volume_attachments/9d98e124-4cf0-4990-81ac-1fd1c13ffd0d" status: 202 len: 0 microversion: 2.1 time: 0.198612 Sep 06 21:28:27.835672 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 651/1311] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Sep 6 21:28:27 2022] DELETE /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a/os-volume_attachments/9d98e124-4cf0-4990-81ac-1fd1c13ffd0d => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:28:27.844479 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2e175487-a5b8-4683-9402-177f96afd4dc tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:28:27.846668 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2e175487-a5b8-4683-9402-177f96afd4dc tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:28:27.853181 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e175487-a5b8-4683-9402-177f96afd4dc tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:27.853658 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e175487-a5b8-4683-9402-177f96afd4dc tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:27.854090 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e175487-a5b8-4683-9402-177f96afd4dc tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:27.854809 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e175487-a5b8-4683-9402-177f96afd4dc tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:27.855275 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e175487-a5b8-4683-9402-177f96afd4dc tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:27.855716 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e175487-a5b8-4683-9402-177f96afd4dc tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:27.888531 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2e175487-a5b8-4683-9402-177f96afd4dc tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048241 Sep 06 21:28:27.889162 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 661/1312] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:28:27 2022] GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:28:28.906093 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-14cf3ee9-f269-49cf-8173-17bc8688ee4f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:28:28.909175 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-14cf3ee9-f269-49cf-8173-17bc8688ee4f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:28:28.918001 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14cf3ee9-f269-49cf-8173-17bc8688ee4f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:28.918777 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14cf3ee9-f269-49cf-8173-17bc8688ee4f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:28.918922 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14cf3ee9-f269-49cf-8173-17bc8688ee4f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:28.919598 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14cf3ee9-f269-49cf-8173-17bc8688ee4f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:28.920023 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14cf3ee9-f269-49cf-8173-17bc8688ee4f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:28.920445 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14cf3ee9-f269-49cf-8173-17bc8688ee4f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:28.951209 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-14cf3ee9-f269-49cf-8173-17bc8688ee4f tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051715 Sep 06 21:28:28.951774 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 652/1313] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:28:28 2022] GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 21:28:29.016909 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-96b28924-bb4c-4cd9-9eb6-bb715df0035c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:28:29.017481 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-96b28924-bb4c-4cd9-9eb6-bb715df0035c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:28:29.024810 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96b28924-bb4c-4cd9-9eb6-bb715df0035c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:29.025294 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96b28924-bb4c-4cd9-9eb6-bb715df0035c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:29.025757 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96b28924-bb4c-4cd9-9eb6-bb715df0035c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:29.026459 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96b28924-bb4c-4cd9-9eb6-bb715df0035c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:29.026903 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96b28924-bb4c-4cd9-9eb6-bb715df0035c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:29.027326 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96b28924-bb4c-4cd9-9eb6-bb715df0035c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:29.053787 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-96b28924-bb4c-4cd9-9eb6-bb715df0035c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 21:28:29.138511 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-96b28924-bb4c-4cd9-9eb6-bb715df0035c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "DELETE /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a" status: 204 len: 0 microversion: 2.1 time: 0.125300 Sep 06 21:28:29.139135 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 662/1314] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Sep 6 21:28:29 2022] DELETE /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 21:28:29.148074 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-37640056-51ab-4478-a845-e1a57133fea5 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:28:29.148720 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-37640056-51ab-4478-a845-e1a57133fea5 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:28:29.155061 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-37640056-51ab-4478-a845-e1a57133fea5 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:29.155545 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-37640056-51ab-4478-a845-e1a57133fea5 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:29.155962 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-37640056-51ab-4478-a845-e1a57133fea5 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:29.156710 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-37640056-51ab-4478-a845-e1a57133fea5 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:29.157121 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-37640056-51ab-4478-a845-e1a57133fea5 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:29.157539 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-37640056-51ab-4478-a845-e1a57133fea5 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:29.294725 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-37640056-51ab-4478-a845-e1a57133fea5 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:28:29.302999 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-37640056-51ab-4478-a845-e1a57133fea5 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a" status: 200 len: 1679 microversion: 2.1 time: 0.159028 Sep 06 21:28:29.303551 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 653/1315] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:28:29 2022] GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:28:30.332175 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-485579b7-9ea1-4633-ab2a-fca8c88341fa tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:28:30.333315 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-485579b7-9ea1-4633-ab2a-fca8c88341fa tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:28:30.344388 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-485579b7-9ea1-4633-ab2a-fca8c88341fa tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:30.345247 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-485579b7-9ea1-4633-ab2a-fca8c88341fa tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:30.345972 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-485579b7-9ea1-4633-ab2a-fca8c88341fa tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:30.347124 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-485579b7-9ea1-4633-ab2a-fca8c88341fa tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:30.347871 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-485579b7-9ea1-4633-ab2a-fca8c88341fa tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:30.348579 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-485579b7-9ea1-4633-ab2a-fca8c88341fa tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:30.501556 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-485579b7-9ea1-4633-ab2a-fca8c88341fa tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:28:30.512278 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-485579b7-9ea1-4633-ab2a-fca8c88341fa tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a" status: 200 len: 1679 microversion: 2.1 time: 0.187428 Sep 06 21:28:30.512881 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 663/1316] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:28:30 2022] GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a => generated 1679 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:28:31.535387 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-13bc178f-a873-414e-8d93-f121e44c6779 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:28:31.536021 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-13bc178f-a873-414e-8d93-f121e44c6779 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:28:31.543603 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13bc178f-a873-414e-8d93-f121e44c6779 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:31.544108 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13bc178f-a873-414e-8d93-f121e44c6779 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:31.544548 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13bc178f-a873-414e-8d93-f121e44c6779 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:31.545275 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13bc178f-a873-414e-8d93-f121e44c6779 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:31.545723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13bc178f-a873-414e-8d93-f121e44c6779 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:31.546142 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13bc178f-a873-414e-8d93-f121e44c6779 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:31.682785 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-13bc178f-a873-414e-8d93-f121e44c6779 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:28:31.691286 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-13bc178f-a873-414e-8d93-f121e44c6779 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a" status: 200 len: 1679 microversion: 2.1 time: 0.159887 Sep 06 21:28:31.691846 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 654/1317] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:28:31 2022] GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:28:32.431424 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-ac2b2c8a-b8eb-44cc-b80e-9fb01c5ca60c req-9af7f8f5-8a85-4dc5-ba73-b62a00366cbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03eaf3bf-fadc-452d-97c1-7faa2414a36a", "name": "network-vif-deleted", "tag": "293351b9-5d85-4302-8939-0947aa6237d5"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:28:32.442193 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ac2b2c8a-b8eb-44cc-b80e-9fb01c5ca60c req-9af7f8f5-8a85-4dc5-ba73-b62a00366cbc service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:32.442620 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ac2b2c8a-b8eb-44cc-b80e-9fb01c5ca60c req-9af7f8f5-8a85-4dc5-ba73-b62a00366cbc service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:32.443044 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-ac2b2c8a-b8eb-44cc-b80e-9fb01c5ca60c req-9af7f8f5-8a85-4dc5-ba73-b62a00366cbc service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:32.455395 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-ac2b2c8a-b8eb-44cc-b80e-9fb01c5ca60c req-9af7f8f5-8a85-4dc5-ba73-b62a00366cbc service nova] Creating event network-vif-deleted:293351b9-5d85-4302-8939-0947aa6237d5 for instance 03eaf3bf-fadc-452d-97c1-7faa2414a36a on hv-cinder-74915 Sep 06 21:28:32.460251 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-ac2b2c8a-b8eb-44cc-b80e-9fb01c5ca60c req-9af7f8f5-8a85-4dc5-ba73-b62a00366cbc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032706 Sep 06 21:28:32.460850 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 664/1318] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:28:32.714576 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-79a8c127-a2ec-48d2-b9a0-37af435aaa11 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:28:32.715185 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-79a8c127-a2ec-48d2-b9a0-37af435aaa11 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:28:32.721924 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79a8c127-a2ec-48d2-b9a0-37af435aaa11 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:32.722407 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79a8c127-a2ec-48d2-b9a0-37af435aaa11 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:32.722836 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79a8c127-a2ec-48d2-b9a0-37af435aaa11 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:32.723533 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79a8c127-a2ec-48d2-b9a0-37af435aaa11 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:32.723974 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79a8c127-a2ec-48d2-b9a0-37af435aaa11 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:32.724394 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79a8c127-a2ec-48d2-b9a0-37af435aaa11 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:32.757354 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79a8c127-a2ec-48d2-b9a0-37af435aaa11 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:32.757842 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79a8c127-a2ec-48d2-b9a0-37af435aaa11 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:32.758287 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79a8c127-a2ec-48d2-b9a0-37af435aaa11 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:32.758745 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-79a8c127-a2ec-48d2-b9a0-37af435aaa11 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lazy-loading 'fault' on Instance uuid 03eaf3bf-fadc-452d-97c1-7faa2414a36a {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:28:32.805052 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-79a8c127-a2ec-48d2-b9a0-37af435aaa11 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:28:32.813317 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-79a8c127-a2ec-48d2-b9a0-37af435aaa11 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a" status: 200 len: 1330 microversion: 2.1 time: 0.102562 Sep 06 21:28:32.813877 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 655/1319] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:28:32 2022] GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a => generated 1330 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:28:33.839554 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b5a19ec7-949b-4a25-b697-58206983b3dd tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:28:33.840156 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b5a19ec7-949b-4a25-b697-58206983b3dd tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:28:33.847314 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5a19ec7-949b-4a25-b697-58206983b3dd tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:33.847794 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5a19ec7-949b-4a25-b697-58206983b3dd tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:33.848226 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5a19ec7-949b-4a25-b697-58206983b3dd tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:33.848960 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5a19ec7-949b-4a25-b697-58206983b3dd tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:33.849409 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5a19ec7-949b-4a25-b697-58206983b3dd tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:33.849857 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b5a19ec7-949b-4a25-b697-58206983b3dd tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:33.864381 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-b5a19ec7-949b-4a25-b697-58206983b3dd tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] HTTP exception thrown: Instance 03eaf3bf-fadc-452d-97c1-7faa2414a36a could not be found. Sep 06 21:28:33.866132 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b5a19ec7-949b-4a25-b697-58206983b3dd tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Request method failure captured: Sep 06 21:28:33.866132 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a HTTP/1.1 Sep 06 21:28:33.866132 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:28:33.866132 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:28:33.866132 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:28:33.866132 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:28:33.866132 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:28:33.866132 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:28:33.866132 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:28:33.866132 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:28:33.866132 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7oBRUaWFmUaRMRrY2lmG27XTCe8m7oOenu15JckXMhNFYDIb6s6CTPHxEIINys886U3nqIXNvhOhvtXDn-W2TtU1LkNmSf6teGC7l2Pr1U-HL4_5PeX8X3jMoeu0l-wC_3RYNggU9GitVP5pFTsCQ7cQZQ9cQw1uf_6XEJXvRawCjA Sep 06 21:28:33.866132 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:28:33.866132 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:28:33.866132 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:28:33.866132 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:28:33.866132 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:28:33.866132 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:28:33.866132 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: 0ca0b63bd9224370b45e7cc5e9c68a27 Sep 06 21:28:33.866132 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:28:33.866132 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:28:33.866132 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:28:33.868002 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0ca0b63bd9224370b45e7cc5e9c68a27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0ca0b63bd9224370b45e7cc5e9c68a27", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ca0b63bd9224370b45e7cc5e9c68a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ca0b63bd9224370b45e7cc5e9c68a27"}]}] Sep 06 21:28:33.868002 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:28:33.868002 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 0ca0b63bd9224370b45e7cc5e9c68a27 Sep 06 21:28:33.868002 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:28:33.868002 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeNegativeTest-1682827976-project Sep 06 21:28:33.868002 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:28:33.868002 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:28:33.868002 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: e22472efcb9a454688744457cb45eabb Sep 06 21:28:33.868002 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeNegativeTest-1682827976-project Sep 06 21:28:33.868002 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: > Sep 06 21:28:33.868002 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Instance 03eaf3bf-fadc-452d-97c1-7faa2414a36a could not be found. Sep 06 21:28:33.868002 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'id': '03eaf3bf-fadc-452d-97c1-7faa2414a36a'} Sep 06 21:28:33.869075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:28:33.869075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:28:33.869075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:28:33.869075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:28:33.869075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:28:33.869075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:28:33.869075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:28:33.869075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:28:33.869075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:28:33.869075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:28:33.869075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03eaf3bf-fadc-452d-97c1-7faa2414a36a could not be found. Sep 06 21:28:33.869075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:28:33.869075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:28:33.869075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:28:33.869075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:28:33.869075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:28:33.869075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:28:33.869075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:28:33.869075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:28:33.869075 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:28:33.870588 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:28:33.870588 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:28:33.870588 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:28:33.870588 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:28:33.870588 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:28:33.870588 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:28:33.870588 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:28:33.870588 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03eaf3bf-fadc-452d-97c1-7faa2414a36a could not be found. Sep 06 21:28:33.870588 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:28:33.870588 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:28:33.870588 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:28:33.870588 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:28:33.870588 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:28:33.870588 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:28:33.870588 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:28:33.870588 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:28:33.870588 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03eaf3bf-fadc-452d-97c1-7faa2414a36a could not be found. Sep 06 21:28:33.870588 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:28:33.871960 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b5a19ec7-949b-4a25-b697-58206983b3dd tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Returning 404 to user: Instance 03eaf3bf-fadc-452d-97c1-7faa2414a36a could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:28:33.871960 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b5a19ec7-949b-4a25-b697-58206983b3dd tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a" status: 404 len: 111 microversion: 2.1 time: 0.033757 Sep 06 21:28:33.871960 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 665/1320] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:28:33 2022] GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:28:33.880492 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5e67009d-5d3e-4c04-86b3-1c0402ca9b75 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '.version_select at 0x7f04ce565c10>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:28:33.901062 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5e67009d-5d3e-4c04-86b3-1c0402ca9b75 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-108857745" status: 202 len: 0 microversion: 2.1 time: 0.024625 Sep 06 21:28:33.901884 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 656/1321] 10.222.0.79 () {58 vars in 1218 bytes} [Tue Sep 6 21:28:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-108857745 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:28:34.540062 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-72774d19-cca4-4686-9200-2899a4d03d8e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Action: 'create', calling method: .version_select at 0x7f04ce6da550>, body: {"keypair": {"name": "tempest-keypair-1854038291", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMq+9XvfmtGIHv2LNOya2ZaSpGuN3mEPq+0GXT3BQxVx7NoF1sGzELr577MXPSgH/XDH+K54SugZ4rP5pLD/vnrcfxinKkErlZo3us1MukIpPqMz3ZX/SAJzkqnVfCAfAA=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:28:34.568291 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-72774d19-cca4-4686-9200-2899a4d03d8e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Getting quotas for project 0ca0b63bd9224370b45e7cc5e9c68a27. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:28:34.573205 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-72774d19-cca4-4686-9200-2899a4d03d8e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Getting quotas for user e22472efcb9a454688744457cb45eabb and project 0ca0b63bd9224370b45e7cc5e9c68a27. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:28:34.599953 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-72774d19-cca4-4686-9200-2899a4d03d8e tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.070241 Sep 06 21:28:34.600752 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 666/1322] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Sep 6 21:28:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:28:35.877739 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cc3e379f-72f0-49ef-9bbc-c18026a506db tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-168625241", "imageRef": "8b4a7612-517c-4711-8637-36b221338f65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1fbc3f3e-7fe7-459b-8f2b-1c8b1d601e7b"}], "security_groups": [{"name": "tempest-securitygroup--836338534"}], "key_name": "tempest-keypair-1854038291", "user_data": "}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:28:35.995987 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-cc3e379f-72f0-49ef-9bbc-c18026a506db tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] validate_networks() for [('1fbc3f3e-7fe7-459b-8f2b-1c8b1d601e7b', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 21:28:36.638182 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-cc3e379f-72f0-49ef-9bbc-c18026a506db tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 21:28:36.638604 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-cc3e379f-72f0-49ef-9bbc-c18026a506db tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 21:28:36.639079 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-cc3e379f-72f0-49ef-9bbc-c18026a506db tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 21:28:36.639484 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-cc3e379f-72f0-49ef-9bbc-c18026a506db tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 21:28:36.639893 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-cc3e379f-72f0-49ef-9bbc-c18026a506db tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 21:28:36.656100 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc3e379f-72f0-49ef-9bbc-c18026a506db tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:36.656582 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc3e379f-72f0-49ef-9bbc-c18026a506db tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:36.657046 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc3e379f-72f0-49ef-9bbc-c18026a506db tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:36.657774 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc3e379f-72f0-49ef-9bbc-c18026a506db tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:36.658219 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc3e379f-72f0-49ef-9bbc-c18026a506db tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:36.658642 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc3e379f-72f0-49ef-9bbc-c18026a506db tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:36.676939 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-cc3e379f-72f0-49ef-9bbc-c18026a506db tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Getting quotas for project 0ca0b63bd9224370b45e7cc5e9c68a27. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 21:28:36.681550 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-cc3e379f-72f0-49ef-9bbc-c18026a506db tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Getting quotas for user e22472efcb9a454688744457cb45eabb and project 0ca0b63bd9224370b45e7cc5e9c68a27. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 21:28:36.693837 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cc3e379f-72f0-49ef-9bbc-c18026a506db tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 21:28:36.696166 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cc3e379f-72f0-49ef-9bbc-c18026a506db tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: d9c7094f-8cdb-4851-bd30-2aba5f98acc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8b4a7612-517c-4711-8637-36b221338f65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 21:28:36.746591 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cc3e379f-72f0-49ef-9bbc-c18026a506db tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.873745 Sep 06 21:28:36.747495 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 657/1323] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Sep 6 21:28:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 21:28:36.760494 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f48e1074-6403-4050-b93e-afbf5f1c62b3 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:28:36.761412 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f48e1074-6403-4050-b93e-afbf5f1c62b3 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: d9c7094f-8cdb-4851-bd30-2aba5f98acc5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:28:36.817842 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f48e1074-6403-4050-b93e-afbf5f1c62b3 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:28:36.824946 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f48e1074-6403-4050-b93e-afbf5f1c62b3 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5" status: 200 len: 1241 microversion: 2.1 time: 0.069983 Sep 06 21:28:36.825537 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 667/1324] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:28:36 2022] GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:28:37.849522 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-28d07cea-141b-481c-bf99-ac4556aee884 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:28:37.850080 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-28d07cea-141b-481c-bf99-ac4556aee884 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: d9c7094f-8cdb-4851-bd30-2aba5f98acc5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:28:37.857372 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28d07cea-141b-481c-bf99-ac4556aee884 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:37.857844 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28d07cea-141b-481c-bf99-ac4556aee884 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:37.858266 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28d07cea-141b-481c-bf99-ac4556aee884 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:37.858961 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28d07cea-141b-481c-bf99-ac4556aee884 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:37.859406 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28d07cea-141b-481c-bf99-ac4556aee884 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:37.860010 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28d07cea-141b-481c-bf99-ac4556aee884 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:37.923446 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-28d07cea-141b-481c-bf99-ac4556aee884 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:28:37.931806 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-28d07cea-141b-481c-bf99-ac4556aee884 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5" status: 200 len: 1293 microversion: 2.1 time: 0.086890 Sep 06 21:28:37.932381 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 658/1325] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:28:37 2022] GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:28:38.955378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-be4346a8-fa27-454a-9e75-022f9e55aeb9 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:28:38.956005 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-be4346a8-fa27-454a-9e75-022f9e55aeb9 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: d9c7094f-8cdb-4851-bd30-2aba5f98acc5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:28:38.963833 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be4346a8-fa27-454a-9e75-022f9e55aeb9 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:38.964035 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be4346a8-fa27-454a-9e75-022f9e55aeb9 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:38.964467 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be4346a8-fa27-454a-9e75-022f9e55aeb9 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:38.965267 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be4346a8-fa27-454a-9e75-022f9e55aeb9 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:38.965790 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be4346a8-fa27-454a-9e75-022f9e55aeb9 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:38.966280 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be4346a8-fa27-454a-9e75-022f9e55aeb9 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:39.201904 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-be4346a8-fa27-454a-9e75-022f9e55aeb9 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:28:39.210311 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-be4346a8-fa27-454a-9e75-022f9e55aeb9 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5" status: 200 len: 1366 microversion: 2.1 time: 0.258804 Sep 06 21:28:39.210860 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 668/1326] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:28:38 2022] GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:28:39.590152 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-2b50c1c0-2d6d-464e-aa0c-c0fbf725011e req-a21b8376-c778-439f-905f-d5c54bf92fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9c7094f-8cdb-4851-bd30-2aba5f98acc5", "tag": "6f854815-005a-4c8f-8df3-38da0e771bab"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:28:39.601715 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2b50c1c0-2d6d-464e-aa0c-c0fbf725011e req-a21b8376-c778-439f-905f-d5c54bf92fb2 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:39.602536 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2b50c1c0-2d6d-464e-aa0c-c0fbf725011e req-a21b8376-c778-439f-905f-d5c54bf92fb2 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:39.603070 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2b50c1c0-2d6d-464e-aa0c-c0fbf725011e req-a21b8376-c778-439f-905f-d5c54bf92fb2 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:39.615140 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-2b50c1c0-2d6d-464e-aa0c-c0fbf725011e req-a21b8376-c778-439f-905f-d5c54bf92fb2 service nova] Creating event network-changed:6f854815-005a-4c8f-8df3-38da0e771bab for instance d9c7094f-8cdb-4851-bd30-2aba5f98acc5 on hv-cinder-74915 Sep 06 21:28:39.620317 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-2b50c1c0-2d6d-464e-aa0c-c0fbf725011e req-a21b8376-c778-439f-905f-d5c54bf92fb2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034256 Sep 06 21:28:39.620964 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 659/1327] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 21:28:40.237068 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-21eac0a8-c7ff-4dc7-aa5e-ca777692d204 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:28:40.237802 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-21eac0a8-c7ff-4dc7-aa5e-ca777692d204 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: d9c7094f-8cdb-4851-bd30-2aba5f98acc5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:28:40.246928 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21eac0a8-c7ff-4dc7-aa5e-ca777692d204 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:40.247594 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21eac0a8-c7ff-4dc7-aa5e-ca777692d204 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:40.248164 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21eac0a8-c7ff-4dc7-aa5e-ca777692d204 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:40.249115 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21eac0a8-c7ff-4dc7-aa5e-ca777692d204 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:40.249702 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21eac0a8-c7ff-4dc7-aa5e-ca777692d204 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:40.250254 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-21eac0a8-c7ff-4dc7-aa5e-ca777692d204 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:40.395221 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-21eac0a8-c7ff-4dc7-aa5e-ca777692d204 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:28:40.403176 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-21eac0a8-c7ff-4dc7-aa5e-ca777692d204 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5" status: 200 len: 1366 microversion: 2.1 time: 0.171393 Sep 06 21:28:40.403726 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 669/1328] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:28:40 2022] GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:28:41.427968 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5285ff08-8642-438e-9e21-160de3cf2eb7 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:28:41.428620 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5285ff08-8642-438e-9e21-160de3cf2eb7 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: d9c7094f-8cdb-4851-bd30-2aba5f98acc5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:28:41.435740 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5285ff08-8642-438e-9e21-160de3cf2eb7 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:41.436223 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5285ff08-8642-438e-9e21-160de3cf2eb7 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:41.436669 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5285ff08-8642-438e-9e21-160de3cf2eb7 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:41.437380 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5285ff08-8642-438e-9e21-160de3cf2eb7 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:41.437827 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5285ff08-8642-438e-9e21-160de3cf2eb7 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:41.438249 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5285ff08-8642-438e-9e21-160de3cf2eb7 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:41.573402 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5285ff08-8642-438e-9e21-160de3cf2eb7 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:28:41.581679 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5285ff08-8642-438e-9e21-160de3cf2eb7 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5" status: 200 len: 1366 microversion: 2.1 time: 0.158554 Sep 06 21:28:41.582312 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 660/1329] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:28:41 2022] GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:28:42.605611 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7822490e-225f-4feb-88b0-7b15d9d0d8ae tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:28:42.606202 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7822490e-225f-4feb-88b0-7b15d9d0d8ae tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: d9c7094f-8cdb-4851-bd30-2aba5f98acc5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:28:42.613862 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7822490e-225f-4feb-88b0-7b15d9d0d8ae tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:42.614337 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7822490e-225f-4feb-88b0-7b15d9d0d8ae tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:42.614767 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7822490e-225f-4feb-88b0-7b15d9d0d8ae tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:42.615470 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7822490e-225f-4feb-88b0-7b15d9d0d8ae tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:42.615913 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7822490e-225f-4feb-88b0-7b15d9d0d8ae tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:42.616334 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7822490e-225f-4feb-88b0-7b15d9d0d8ae tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:42.818169 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7822490e-225f-4feb-88b0-7b15d9d0d8ae tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:28:42.826473 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7822490e-225f-4feb-88b0-7b15d9d0d8ae tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5" status: 200 len: 1366 microversion: 2.1 time: 0.224783 Sep 06 21:28:42.827045 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 670/1330] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:28:42 2022] GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:28:43.855718 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b559cd82-d770-4101-94df-c01dd0b482be tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:28:43.856761 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b559cd82-d770-4101-94df-c01dd0b482be tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: d9c7094f-8cdb-4851-bd30-2aba5f98acc5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:28:43.868160 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b559cd82-d770-4101-94df-c01dd0b482be tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:43.869123 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b559cd82-d770-4101-94df-c01dd0b482be tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:43.869868 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b559cd82-d770-4101-94df-c01dd0b482be tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:43.870945 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b559cd82-d770-4101-94df-c01dd0b482be tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:43.871400 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b559cd82-d770-4101-94df-c01dd0b482be tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:43.871822 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b559cd82-d770-4101-94df-c01dd0b482be tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:44.082584 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b559cd82-d770-4101-94df-c01dd0b482be tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:28:44.092929 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b559cd82-d770-4101-94df-c01dd0b482be tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5" status: 200 len: 1366 microversion: 2.1 time: 0.243771 Sep 06 21:28:44.093567 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 661/1331] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:28:43 2022] GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:28:45.120491 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2c307ae1-138a-4777-868f-930c5c5d041d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:28:45.121070 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2c307ae1-138a-4777-868f-930c5c5d041d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: d9c7094f-8cdb-4851-bd30-2aba5f98acc5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:28:45.131926 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c307ae1-138a-4777-868f-930c5c5d041d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:45.132633 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c307ae1-138a-4777-868f-930c5c5d041d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:45.133304 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c307ae1-138a-4777-868f-930c5c5d041d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:45.134394 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c307ae1-138a-4777-868f-930c5c5d041d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:45.135066 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c307ae1-138a-4777-868f-930c5c5d041d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:45.135639 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c307ae1-138a-4777-868f-930c5c5d041d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:45.331328 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2c307ae1-138a-4777-868f-930c5c5d041d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:28:45.340298 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2c307ae1-138a-4777-868f-930c5c5d041d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5" status: 200 len: 1366 microversion: 2.1 time: 0.226604 Sep 06 21:28:45.340922 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 671/1332] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:28:45 2022] GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:28:46.363671 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ac577f63-35b7-41d1-acb6-7c2c0abee8ec tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:28:46.364245 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ac577f63-35b7-41d1-acb6-7c2c0abee8ec tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: d9c7094f-8cdb-4851-bd30-2aba5f98acc5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:28:46.371517 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac577f63-35b7-41d1-acb6-7c2c0abee8ec tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:46.372042 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac577f63-35b7-41d1-acb6-7c2c0abee8ec tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:46.372517 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac577f63-35b7-41d1-acb6-7c2c0abee8ec tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:46.373238 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac577f63-35b7-41d1-acb6-7c2c0abee8ec tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:46.373705 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac577f63-35b7-41d1-acb6-7c2c0abee8ec tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:46.374133 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac577f63-35b7-41d1-acb6-7c2c0abee8ec tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:46.391512 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-7fc311e3-d782-40c9-b089-491f5a9d182e req-007fd34a-3b0a-46c2-acb0-53c41a423701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9c7094f-8cdb-4851-bd30-2aba5f98acc5", "name": "network-vif-plugged", "status": "completed", "tag": "6f854815-005a-4c8f-8df3-38da0e771bab"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:28:46.402865 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-7fc311e3-d782-40c9-b089-491f5a9d182e req-007fd34a-3b0a-46c2-acb0-53c41a423701 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:46.403422 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-7fc311e3-d782-40c9-b089-491f5a9d182e req-007fd34a-3b0a-46c2-acb0-53c41a423701 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:46.404067 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-7fc311e3-d782-40c9-b089-491f5a9d182e req-007fd34a-3b0a-46c2-acb0-53c41a423701 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:46.427020 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-7fc311e3-d782-40c9-b089-491f5a9d182e req-007fd34a-3b0a-46c2-acb0-53c41a423701 service nova] Creating event network-vif-plugged:6f854815-005a-4c8f-8df3-38da0e771bab for instance d9c7094f-8cdb-4851-bd30-2aba5f98acc5 on hv-cinder-74915 Sep 06 21:28:46.443083 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-7fc311e3-d782-40c9-b089-491f5a9d182e req-007fd34a-3b0a-46c2-acb0-53c41a423701 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055355 Sep 06 21:28:46.443858 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 672/1333] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:28:46.529048 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ac577f63-35b7-41d1-acb6-7c2c0abee8ec tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:28:46.537542 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ac577f63-35b7-41d1-acb6-7c2c0abee8ec tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5" status: 200 len: 1366 microversion: 2.1 time: 0.177896 Sep 06 21:28:46.538125 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 662/1334] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:28:46 2022] GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:28:47.562353 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:47.567600 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-12347de6-77d1-4bcd-af02-1dbf3078998d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:28:47.568314 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-12347de6-77d1-4bcd-af02-1dbf3078998d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: d9c7094f-8cdb-4851-bd30-2aba5f98acc5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:28:47.574723 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12347de6-77d1-4bcd-af02-1dbf3078998d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:47.575187 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12347de6-77d1-4bcd-af02-1dbf3078998d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:47.575610 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12347de6-77d1-4bcd-af02-1dbf3078998d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:47.576283 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12347de6-77d1-4bcd-af02-1dbf3078998d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:47.576746 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12347de6-77d1-4bcd-af02-1dbf3078998d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:47.577162 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12347de6-77d1-4bcd-af02-1dbf3078998d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:47.710653 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-12347de6-77d1-4bcd-af02-1dbf3078998d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:28:47.720793 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-12347de6-77d1-4bcd-af02-1dbf3078998d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5" status: 200 len: 1366 microversion: 2.1 time: 0.160632 Sep 06 21:28:47.721380 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 673/1335] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:28:47 2022] GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:28:48.744615 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-90a72c06-f7b4-4f86-bca5-3cce9da471a4 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:28:48.745355 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-90a72c06-f7b4-4f86-bca5-3cce9da471a4 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: d9c7094f-8cdb-4851-bd30-2aba5f98acc5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:28:48.747668 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:48.748397 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:48.756403 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90a72c06-f7b4-4f86-bca5-3cce9da471a4 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:48.757040 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90a72c06-f7b4-4f86-bca5-3cce9da471a4 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:48.757582 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90a72c06-f7b4-4f86-bca5-3cce9da471a4 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:48.758417 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90a72c06-f7b4-4f86-bca5-3cce9da471a4 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:48.758953 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90a72c06-f7b4-4f86-bca5-3cce9da471a4 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:48.759482 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90a72c06-f7b4-4f86-bca5-3cce9da471a4 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:48.910784 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-90a72c06-f7b4-4f86-bca5-3cce9da471a4 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:28:48.919084 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-90a72c06-f7b4-4f86-bca5-3cce9da471a4 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5" status: 200 len: 1556 microversion: 2.1 time: 0.179221 Sep 06 21:28:48.919656 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 663/1336] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:28:48 2022] GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5 => generated 1556 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:28:48.945216 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cc0cb540-c3ff-4c31-ac3c-ece66b39ae7d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:28:48.945935 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cc0cb540-c3ff-4c31-ac3c-ece66b39ae7d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: d9c7094f-8cdb-4851-bd30-2aba5f98acc5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:28:48.949317 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:48.957792 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc0cb540-c3ff-4c31-ac3c-ece66b39ae7d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:48.958414 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc0cb540-c3ff-4c31-ac3c-ece66b39ae7d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:48.958854 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc0cb540-c3ff-4c31-ac3c-ece66b39ae7d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:48.959895 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc0cb540-c3ff-4c31-ac3c-ece66b39ae7d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:48.960634 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc0cb540-c3ff-4c31-ac3c-ece66b39ae7d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:48.961284 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc0cb540-c3ff-4c31-ac3c-ece66b39ae7d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:48.968367 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:49.048957 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cc0cb540-c3ff-4c31-ac3c-ece66b39ae7d tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107739 Sep 06 21:28:49.049723 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 674/1337] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Sep 6 21:28:48 2022] GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:28:50.270523 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a9e990cb-51f1-410c-a034-14826b1eaf96 req-a129cab0-80e3-4c1a-b94d-c5bb77304820 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9c7094f-8cdb-4851-bd30-2aba5f98acc5", "tag": "6f854815-005a-4c8f-8df3-38da0e771bab"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:28:50.277188 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:50.281553 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a9e990cb-51f1-410c-a034-14826b1eaf96 req-a129cab0-80e3-4c1a-b94d-c5bb77304820 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:28:50.282018 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a9e990cb-51f1-410c-a034-14826b1eaf96 req-a129cab0-80e3-4c1a-b94d-c5bb77304820 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:28:50.282454 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a9e990cb-51f1-410c-a034-14826b1eaf96 req-a129cab0-80e3-4c1a-b94d-c5bb77304820 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:28:50.285586 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:50.297807 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a9e990cb-51f1-410c-a034-14826b1eaf96 req-a129cab0-80e3-4c1a-b94d-c5bb77304820 service nova] Creating event network-changed:6f854815-005a-4c8f-8df3-38da0e771bab for instance d9c7094f-8cdb-4851-bd30-2aba5f98acc5 on hv-cinder-74915 Sep 06 21:28:50.303449 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a9e990cb-51f1-410c-a034-14826b1eaf96 req-a129cab0-80e3-4c1a-b94d-c5bb77304820 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036585 Sep 06 21:28:50.304054 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 664/1338] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:29:01.488457 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:29:01.489619 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:29:01.497435 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1e6dcda2-3f41-427b-91ac-2eebfd35b4bd tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:29:01.500815 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1e6dcda2-3f41-427b-91ac-2eebfd35b4bd tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:29:01.510024 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e6dcda2-3f41-427b-91ac-2eebfd35b4bd tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:29:01.510505 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e6dcda2-3f41-427b-91ac-2eebfd35b4bd tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:29:01.510938 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e6dcda2-3f41-427b-91ac-2eebfd35b4bd tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:29:01.511640 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e6dcda2-3f41-427b-91ac-2eebfd35b4bd tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:29:01.512087 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e6dcda2-3f41-427b-91ac-2eebfd35b4bd tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:29:01.512510 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e6dcda2-3f41-427b-91ac-2eebfd35b4bd tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:29:01.589083 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1e6dcda2-3f41-427b-91ac-2eebfd35b4bd tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "POST /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4/action" status: 202 len: 0 microversion: 2.1 time: 0.103166 Sep 06 21:29:01.592597 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 675/1339] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Sep 6 21:29:01 2022] POST /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:29:01.599514 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5f1c9d82-b9e1-4c4b-bdd4-b005ec81590a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:29:01.600403 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5f1c9d82-b9e1-4c4b-bdd4-b005ec81590a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:29:01.608408 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f1c9d82-b9e1-4c4b-bdd4-b005ec81590a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:29:01.609134 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f1c9d82-b9e1-4c4b-bdd4-b005ec81590a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:29:01.609756 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f1c9d82-b9e1-4c4b-bdd4-b005ec81590a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:29:01.610297 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f1c9d82-b9e1-4c4b-bdd4-b005ec81590a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:29:01.610761 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f1c9d82-b9e1-4c4b-bdd4-b005ec81590a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:29:01.611177 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f1c9d82-b9e1-4c4b-bdd4-b005ec81590a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:29:01.757719 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5f1c9d82-b9e1-4c4b-bdd4-b005ec81590a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:29:01.766310 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5f1c9d82-b9e1-4c4b-bdd4-b005ec81590a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1751 microversion: 2.1 time: 0.172053 Sep 06 21:29:01.767095 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 665/1340] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:29:01 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:29:02.792929 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ffbda115-1b1c-4a4e-b1cb-240565043b6c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:29:02.793521 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ffbda115-1b1c-4a4e-b1cb-240565043b6c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:29:02.799973 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ffbda115-1b1c-4a4e-b1cb-240565043b6c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:29:02.800425 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ffbda115-1b1c-4a4e-b1cb-240565043b6c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:29:02.800897 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ffbda115-1b1c-4a4e-b1cb-240565043b6c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:29:02.801594 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ffbda115-1b1c-4a4e-b1cb-240565043b6c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:29:02.802039 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ffbda115-1b1c-4a4e-b1cb-240565043b6c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:29:02.802461 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ffbda115-1b1c-4a4e-b1cb-240565043b6c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:29:03.054894 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ffbda115-1b1c-4a4e-b1cb-240565043b6c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:29:03.066986 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ffbda115-1b1c-4a4e-b1cb-240565043b6c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1756 microversion: 2.1 time: 0.278955 Sep 06 21:29:03.067801 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 676/1341] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:29:02 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1756 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:29:04.095568 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9c960dfe-71e6-4af8-ba89-19f5b96f7bfe tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:29:04.096711 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9c960dfe-71e6-4af8-ba89-19f5b96f7bfe tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:29:04.106634 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c960dfe-71e6-4af8-ba89-19f5b96f7bfe tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:29:04.107410 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c960dfe-71e6-4af8-ba89-19f5b96f7bfe tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:29:04.108085 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c960dfe-71e6-4af8-ba89-19f5b96f7bfe tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:29:04.109237 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c960dfe-71e6-4af8-ba89-19f5b96f7bfe tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:29:04.109972 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c960dfe-71e6-4af8-ba89-19f5b96f7bfe tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:29:04.110634 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c960dfe-71e6-4af8-ba89-19f5b96f7bfe tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:29:04.264816 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9c960dfe-71e6-4af8-ba89-19f5b96f7bfe tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:29:04.275084 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9c960dfe-71e6-4af8-ba89-19f5b96f7bfe tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1756 microversion: 2.1 time: 0.186093 Sep 06 21:29:04.275660 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 666/1342] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:29:04 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:29:05.302285 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7f9acfe1-b99f-4677-b44c-3433dd3397e8 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:29:05.303223 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7f9acfe1-b99f-4677-b44c-3433dd3397e8 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:29:05.314354 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f9acfe1-b99f-4677-b44c-3433dd3397e8 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:29:05.315149 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f9acfe1-b99f-4677-b44c-3433dd3397e8 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:29:05.315887 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f9acfe1-b99f-4677-b44c-3433dd3397e8 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:29:05.317106 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f9acfe1-b99f-4677-b44c-3433dd3397e8 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:29:05.317848 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f9acfe1-b99f-4677-b44c-3433dd3397e8 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:29:05.318580 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f9acfe1-b99f-4677-b44c-3433dd3397e8 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:29:05.473486 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7f9acfe1-b99f-4677-b44c-3433dd3397e8 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:29:05.482272 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7f9acfe1-b99f-4677-b44c-3433dd3397e8 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1756 microversion: 2.1 time: 0.186581 Sep 06 21:29:05.482855 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 677/1343] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:29:05 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:29:06.509114 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-32cd34f4-1fa6-4a28-af15-014a2277ce2b tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:29:06.510068 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-32cd34f4-1fa6-4a28-af15-014a2277ce2b tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:29:06.521205 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32cd34f4-1fa6-4a28-af15-014a2277ce2b tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:29:06.522009 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32cd34f4-1fa6-4a28-af15-014a2277ce2b tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:29:06.522729 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32cd34f4-1fa6-4a28-af15-014a2277ce2b tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:29:06.523421 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32cd34f4-1fa6-4a28-af15-014a2277ce2b tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:29:06.523891 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32cd34f4-1fa6-4a28-af15-014a2277ce2b tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:29:06.524304 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32cd34f4-1fa6-4a28-af15-014a2277ce2b tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:29:06.685094 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-32cd34f4-1fa6-4a28-af15-014a2277ce2b tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:29:06.693734 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-32cd34f4-1fa6-4a28-af15-014a2277ce2b tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1756 microversion: 2.1 time: 0.191186 Sep 06 21:29:06.694380 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 667/1344] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:29:06 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:29:07.721097 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-817c9e5b-2868-40ec-92d7-a871998f8c79 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:29:07.722153 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-817c9e5b-2868-40ec-92d7-a871998f8c79 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:29:07.730720 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-817c9e5b-2868-40ec-92d7-a871998f8c79 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:29:07.731200 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-817c9e5b-2868-40ec-92d7-a871998f8c79 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:29:07.731633 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-817c9e5b-2868-40ec-92d7-a871998f8c79 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:29:07.732329 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-817c9e5b-2868-40ec-92d7-a871998f8c79 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:29:07.732847 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-817c9e5b-2868-40ec-92d7-a871998f8c79 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:29:07.733268 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-817c9e5b-2868-40ec-92d7-a871998f8c79 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:29:07.885502 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-817c9e5b-2868-40ec-92d7-a871998f8c79 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:29:07.893925 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-817c9e5b-2868-40ec-92d7-a871998f8c79 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1756 microversion: 2.1 time: 0.179401 Sep 06 21:29:07.894497 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 678/1345] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:29:07 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:29:08.917407 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6b37775f-19d4-4517-853c-298752d9f15c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:29:08.918048 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6b37775f-19d4-4517-853c-298752d9f15c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:29:08.924755 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b37775f-19d4-4517-853c-298752d9f15c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:29:08.925371 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b37775f-19d4-4517-853c-298752d9f15c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:29:08.925805 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b37775f-19d4-4517-853c-298752d9f15c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:29:08.926502 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b37775f-19d4-4517-853c-298752d9f15c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:29:08.926956 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b37775f-19d4-4517-853c-298752d9f15c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:29:08.927378 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b37775f-19d4-4517-853c-298752d9f15c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:29:09.092062 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6b37775f-19d4-4517-853c-298752d9f15c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:29:09.101406 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6b37775f-19d4-4517-853c-298752d9f15c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1756 microversion: 2.1 time: 0.188572 Sep 06 21:29:09.101988 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 668/1346] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:29:08 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:29:10.129448 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f6829ae6-8945-4ec3-9586-454b97f2d42f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:29:10.130431 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f6829ae6-8945-4ec3-9586-454b97f2d42f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:29:10.141786 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6829ae6-8945-4ec3-9586-454b97f2d42f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:29:10.142575 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6829ae6-8945-4ec3-9586-454b97f2d42f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:29:10.143293 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6829ae6-8945-4ec3-9586-454b97f2d42f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:29:10.144443 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6829ae6-8945-4ec3-9586-454b97f2d42f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:29:10.145350 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6829ae6-8945-4ec3-9586-454b97f2d42f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:29:10.146065 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f6829ae6-8945-4ec3-9586-454b97f2d42f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:29:10.295480 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f6829ae6-8945-4ec3-9586-454b97f2d42f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:29:10.307241 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f6829ae6-8945-4ec3-9586-454b97f2d42f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1756 microversion: 2.1 time: 0.184757 Sep 06 21:29:10.307810 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 679/1347] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:29:10 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:29:11.335199 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-81228c8c-08e2-43a5-bb6f-15037f330545 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:29:11.336211 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-81228c8c-08e2-43a5-bb6f-15037f330545 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:29:11.347165 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81228c8c-08e2-43a5-bb6f-15037f330545 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:29:11.347964 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81228c8c-08e2-43a5-bb6f-15037f330545 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:29:11.348734 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81228c8c-08e2-43a5-bb6f-15037f330545 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:29:11.349865 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81228c8c-08e2-43a5-bb6f-15037f330545 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:29:11.350624 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81228c8c-08e2-43a5-bb6f-15037f330545 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:29:11.351324 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-81228c8c-08e2-43a5-bb6f-15037f330545 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:29:11.501180 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-81228c8c-08e2-43a5-bb6f-15037f330545 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:29:11.512277 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-81228c8c-08e2-43a5-bb6f-15037f330545 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1756 microversion: 2.1 time: 0.183679 Sep 06 21:29:11.512871 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 669/1348] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:29:11 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:29:12.540284 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-abefe061-7d30-4826-86a9-b783ced3694f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:29:12.541359 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-abefe061-7d30-4826-86a9-b783ced3694f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:29:12.553089 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abefe061-7d30-4826-86a9-b783ced3694f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:29:12.553891 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abefe061-7d30-4826-86a9-b783ced3694f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:29:12.554599 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abefe061-7d30-4826-86a9-b783ced3694f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:29:12.555783 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abefe061-7d30-4826-86a9-b783ced3694f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:29:12.556231 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abefe061-7d30-4826-86a9-b783ced3694f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:29:12.556650 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-abefe061-7d30-4826-86a9-b783ced3694f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:29:12.713915 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-abefe061-7d30-4826-86a9-b783ced3694f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:29:12.722391 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-abefe061-7d30-4826-86a9-b783ced3694f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1756 microversion: 2.1 time: 0.188976 Sep 06 21:29:12.722981 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 680/1349] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:29:12 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:29:13.750202 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ae2e3f55-9a13-4ee2-b298-759c2451c8cb tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:29:13.751180 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ae2e3f55-9a13-4ee2-b298-759c2451c8cb tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:29:13.761358 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae2e3f55-9a13-4ee2-b298-759c2451c8cb tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:29:13.761840 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae2e3f55-9a13-4ee2-b298-759c2451c8cb tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:29:13.762274 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae2e3f55-9a13-4ee2-b298-759c2451c8cb tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:29:13.762975 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae2e3f55-9a13-4ee2-b298-759c2451c8cb tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:29:13.763427 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae2e3f55-9a13-4ee2-b298-759c2451c8cb tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:29:13.763846 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae2e3f55-9a13-4ee2-b298-759c2451c8cb tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:29:13.915906 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ae2e3f55-9a13-4ee2-b298-759c2451c8cb tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:29:13.924779 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ae2e3f55-9a13-4ee2-b298-759c2451c8cb tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1759 microversion: 2.1 time: 0.181194 Sep 06 21:29:13.925329 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 670/1350] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:29:13 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1759 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:30:05.421117 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a9301150-44b0-4dac-ab46-f72b7263b743 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:30:05.421752 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a9301150-44b0-4dac-ab46-f72b7263b743 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: d9c7094f-8cdb-4851-bd30-2aba5f98acc5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:30:05.423991 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=12 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:05.424688 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:05.431003 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9301150-44b0-4dac-ab46-f72b7263b743 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:05.431482 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9301150-44b0-4dac-ab46-f72b7263b743 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:05.431916 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9301150-44b0-4dac-ab46-f72b7263b743 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:05.432613 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9301150-44b0-4dac-ab46-f72b7263b743 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:05.433095 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9301150-44b0-4dac-ab46-f72b7263b743 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:05.433514 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9301150-44b0-4dac-ab46-f72b7263b743 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:05.467637 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a9301150-44b0-4dac-ab46-f72b7263b743 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5/ips" status: 200 len: 150 microversion: 2.1 time: 0.050617 Sep 06 21:30:05.468207 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 681/1351] 10.222.0.79 () {58 vars in 1248 bytes} [Tue Sep 6 21:30:05 2022] GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5/ips => generated 150 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:30:06.848451 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cf757d1b-ae23-4b58-a47e-49ee97866870 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e0d21d4-92d6-478d-99e6-dcbdb95a533e"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:30:06.850924 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cf757d1b-ae23-4b58-a47e-49ee97866870 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: d9c7094f-8cdb-4851-bd30-2aba5f98acc5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:30:06.853350 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=13 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:06.854108 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=37 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:06.860880 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf757d1b-ae23-4b58-a47e-49ee97866870 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:06.861402 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf757d1b-ae23-4b58-a47e-49ee97866870 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:06.861842 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf757d1b-ae23-4b58-a47e-49ee97866870 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:06.862561 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf757d1b-ae23-4b58-a47e-49ee97866870 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:06.863013 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf757d1b-ae23-4b58-a47e-49ee97866870 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:06.863436 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf757d1b-ae23-4b58-a47e-49ee97866870 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:07.156233 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cf757d1b-ae23-4b58-a47e-49ee97866870 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "POST /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312620 Sep 06 21:30:07.156882 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 671/1352] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Sep 6 21:30:06 2022] POST /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:30:14.863929 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-404dd223-f3c1-4239-9f78-f1f3efdd67ca tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:30:14.864473 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-404dd223-f3c1-4239-9f78-f1f3efdd67ca tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: d9c7094f-8cdb-4851-bd30-2aba5f98acc5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:30:14.871724 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-404dd223-f3c1-4239-9f78-f1f3efdd67ca tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:14.872200 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-404dd223-f3c1-4239-9f78-f1f3efdd67ca tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:14.872761 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-404dd223-f3c1-4239-9f78-f1f3efdd67ca tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:14.873451 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-404dd223-f3c1-4239-9f78-f1f3efdd67ca tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:14.873968 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-404dd223-f3c1-4239-9f78-f1f3efdd67ca tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:14.874390 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-404dd223-f3c1-4239-9f78-f1f3efdd67ca tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:14.964797 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-404dd223-f3c1-4239-9f78-f1f3efdd67ca tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lazy-loading 'services' on Instance uuid d9c7094f-8cdb-4851-bd30-2aba5f98acc5 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:30:15.044716 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-404dd223-f3c1-4239-9f78-f1f3efdd67ca tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5/os-volume_attachments/0e0d21d4-92d6-478d-99e6-dcbdb95a533e" status: 202 len: 0 microversion: 2.1 time: 0.187128 Sep 06 21:30:15.045313 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 682/1353] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Sep 6 21:30:14 2022] DELETE /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5/os-volume_attachments/0e0d21d4-92d6-478d-99e6-dcbdb95a533e => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:30:15.054908 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-621f17b0-7869-4733-b079-98e4f387e735 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:30:15.057320 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-621f17b0-7869-4733-b079-98e4f387e735 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: d9c7094f-8cdb-4851-bd30-2aba5f98acc5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:30:15.063847 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-621f17b0-7869-4733-b079-98e4f387e735 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:15.064355 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-621f17b0-7869-4733-b079-98e4f387e735 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:15.064756 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-621f17b0-7869-4733-b079-98e4f387e735 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:15.065504 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-621f17b0-7869-4733-b079-98e4f387e735 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:15.065900 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-621f17b0-7869-4733-b079-98e4f387e735 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:15.066311 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-621f17b0-7869-4733-b079-98e4f387e735 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:15.099387 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-621f17b0-7869-4733-b079-98e4f387e735 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049190 Sep 06 21:30:15.099922 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 672/1354] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:30:15 2022] GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:30:16.112546 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-399ee28a-8477-472a-ad8c-41626680700a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:30:16.114986 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-399ee28a-8477-472a-ad8c-41626680700a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: d9c7094f-8cdb-4851-bd30-2aba5f98acc5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:30:16.122211 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-399ee28a-8477-472a-ad8c-41626680700a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:16.122700 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-399ee28a-8477-472a-ad8c-41626680700a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:16.123315 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-399ee28a-8477-472a-ad8c-41626680700a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:16.124100 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-399ee28a-8477-472a-ad8c-41626680700a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:16.124541 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-399ee28a-8477-472a-ad8c-41626680700a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:16.124992 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-399ee28a-8477-472a-ad8c-41626680700a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:16.156296 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-399ee28a-8477-472a-ad8c-41626680700a tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048177 Sep 06 21:30:16.156944 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 683/1355] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:30:16 2022] GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 21:30:16.225057 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3a162ead-0530-4720-a42a-d7e58ef9e32c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:30:16.225650 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3a162ead-0530-4720-a42a-d7e58ef9e32c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: d9c7094f-8cdb-4851-bd30-2aba5f98acc5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:30:16.232265 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a162ead-0530-4720-a42a-d7e58ef9e32c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:16.232911 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a162ead-0530-4720-a42a-d7e58ef9e32c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:16.233350 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a162ead-0530-4720-a42a-d7e58ef9e32c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:16.234058 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a162ead-0530-4720-a42a-d7e58ef9e32c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:16.234504 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a162ead-0530-4720-a42a-d7e58ef9e32c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:16.234918 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a162ead-0530-4720-a42a-d7e58ef9e32c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:16.261143 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3a162ead-0530-4720-a42a-d7e58ef9e32c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: d9c7094f-8cdb-4851-bd30-2aba5f98acc5] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 21:30:16.339837 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3a162ead-0530-4720-a42a-d7e58ef9e32c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5" status: 204 len: 0 microversion: 2.1 time: 0.118507 Sep 06 21:30:16.340424 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 673/1356] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Sep 6 21:30:16 2022] DELETE /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 21:30:16.348887 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1c3c7c34-7020-4450-9bb3-ee430d962366 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:30:16.349491 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1c3c7c34-7020-4450-9bb3-ee430d962366 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: d9c7094f-8cdb-4851-bd30-2aba5f98acc5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:30:16.355531 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c3c7c34-7020-4450-9bb3-ee430d962366 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:16.356001 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c3c7c34-7020-4450-9bb3-ee430d962366 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:16.356425 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c3c7c34-7020-4450-9bb3-ee430d962366 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:16.357131 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c3c7c34-7020-4450-9bb3-ee430d962366 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:16.357585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c3c7c34-7020-4450-9bb3-ee430d962366 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:16.358031 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1c3c7c34-7020-4450-9bb3-ee430d962366 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:16.501107 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1c3c7c34-7020-4450-9bb3-ee430d962366 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:30:16.509463 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1c3c7c34-7020-4450-9bb3-ee430d962366 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5" status: 200 len: 1681 microversion: 2.1 time: 0.164503 Sep 06 21:30:16.510028 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 684/1357] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:30:16 2022] GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:30:17.248690 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dd0df270-ca2d-4935-baae-063113f26746 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1882548395"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:30:17.249536 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dd0df270-ca2d-4935-baae-063113f26746 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:30:17.258713 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd0df270-ca2d-4935-baae-063113f26746 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:17.259190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd0df270-ca2d-4935-baae-063113f26746 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:17.259615 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd0df270-ca2d-4935-baae-063113f26746 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:17.260307 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd0df270-ca2d-4935-baae-063113f26746 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:17.260782 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd0df270-ca2d-4935-baae-063113f26746 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:17.261196 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd0df270-ca2d-4935-baae-063113f26746 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:17.394833 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.network.security_group_api [None req-dd0df270-ca2d-4935-baae-063113f26746 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Removing security group 74c53134-723a-49c7-89eb-057a149e1018 from port c91372e9-966e-469c-bdfc-85d1774fc70b Sep 06 21:30:17.533275 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a7e011e5-16f0-4506-85b0-48ee8d64a01b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:30:17.534509 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a7e011e5-16f0-4506-85b0-48ee8d64a01b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: d9c7094f-8cdb-4851-bd30-2aba5f98acc5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:30:17.541671 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7e011e5-16f0-4506-85b0-48ee8d64a01b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:17.542157 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7e011e5-16f0-4506-85b0-48ee8d64a01b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:17.542595 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7e011e5-16f0-4506-85b0-48ee8d64a01b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:17.543311 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7e011e5-16f0-4506-85b0-48ee8d64a01b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:17.543763 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7e011e5-16f0-4506-85b0-48ee8d64a01b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:17.544187 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7e011e5-16f0-4506-85b0-48ee8d64a01b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:17.681644 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a7e011e5-16f0-4506-85b0-48ee8d64a01b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:30:17.689777 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a7e011e5-16f0-4506-85b0-48ee8d64a01b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5" status: 200 len: 1681 microversion: 2.1 time: 0.160549 Sep 06 21:30:17.690763 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 685/1358] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:30:17 2022] GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:30:17.726125 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dd0df270-ca2d-4935-baae-063113f26746 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "POST /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4/action" status: 202 len: 0 microversion: 2.1 time: 0.484613 Sep 06 21:30:17.726822 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 674/1359] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Sep 6 21:30:17 2022] POST /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:30:17.740457 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-33c64b11-7d11-41c1-b07d-e5b7632a2488 req-675ec586-2e64-4467-ba58-e11b31b3f37f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65014e74-e05a-4c89-ad8b-ec4bab8b9bf4", "tag": "c91372e9-966e-469c-bdfc-85d1774fc70b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:30:17.753825 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-33c64b11-7d11-41c1-b07d-e5b7632a2488 req-675ec586-2e64-4467-ba58-e11b31b3f37f service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:17.755091 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-33c64b11-7d11-41c1-b07d-e5b7632a2488 req-675ec586-2e64-4467-ba58-e11b31b3f37f service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:17.755585 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-33c64b11-7d11-41c1-b07d-e5b7632a2488 req-675ec586-2e64-4467-ba58-e11b31b3f37f service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:17.770024 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-33c64b11-7d11-41c1-b07d-e5b7632a2488 req-675ec586-2e64-4467-ba58-e11b31b3f37f service nova] Creating event network-changed:c91372e9-966e-469c-bdfc-85d1774fc70b for instance 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 on hv-cinder-74915 Sep 06 21:30:17.776972 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-33c64b11-7d11-41c1-b07d-e5b7632a2488 req-675ec586-2e64-4467-ba58-e11b31b3f37f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041316 Sep 06 21:30:17.778218 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 686/1360] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:30:18.714771 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-61c35284-5774-430b-9c80-14fe4543ae46 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:30:18.715521 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-61c35284-5774-430b-9c80-14fe4543ae46 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: d9c7094f-8cdb-4851-bd30-2aba5f98acc5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:30:18.721969 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61c35284-5774-430b-9c80-14fe4543ae46 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:18.722453 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61c35284-5774-430b-9c80-14fe4543ae46 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:18.722899 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61c35284-5774-430b-9c80-14fe4543ae46 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:18.723599 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61c35284-5774-430b-9c80-14fe4543ae46 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:18.724055 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61c35284-5774-430b-9c80-14fe4543ae46 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:18.724555 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61c35284-5774-430b-9c80-14fe4543ae46 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:19.037632 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-61c35284-5774-430b-9c80-14fe4543ae46 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:30:19.046117 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-61c35284-5774-430b-9c80-14fe4543ae46 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5" status: 200 len: 1681 microversion: 2.1 time: 0.335897 Sep 06 21:30:19.046666 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 675/1361] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:30:18 2022] GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5 => generated 1681 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:30:19.307027 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6c1bfabb-5b15-4533-b7b1-8adc54869c9f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:30:19.308917 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6c1bfabb-5b15-4533-b7b1-8adc54869c9f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:30:19.316206 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c1bfabb-5b15-4533-b7b1-8adc54869c9f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:19.316711 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c1bfabb-5b15-4533-b7b1-8adc54869c9f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:19.317147 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c1bfabb-5b15-4533-b7b1-8adc54869c9f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:19.317855 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c1bfabb-5b15-4533-b7b1-8adc54869c9f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:19.318705 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c1bfabb-5b15-4533-b7b1-8adc54869c9f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:19.319314 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c1bfabb-5b15-4533-b7b1-8adc54869c9f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:19.416121 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-6c1bfabb-5b15-4533-b7b1-8adc54869c9f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lazy-loading 'services' on Instance uuid 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 21:30:19.501599 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6c1bfabb-5b15-4533-b7b1-8adc54869c9f tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "DELETE /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4/os-volume_attachments/601755c2-67ab-4a32-aa7e-5f32adf15a2f" status: 202 len: 0 microversion: 2.1 time: 0.199265 Sep 06 21:30:19.505825 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 687/1362] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Sep 6 21:30:19 2022] DELETE /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4/os-volume_attachments/601755c2-67ab-4a32-aa7e-5f32adf15a2f => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:30:19.511385 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ec521c93-d9b7-45c8-a550-a9492d30c20c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:30:19.513853 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ec521c93-d9b7-45c8-a550-a9492d30c20c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:30:19.520270 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec521c93-d9b7-45c8-a550-a9492d30c20c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:19.520989 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec521c93-d9b7-45c8-a550-a9492d30c20c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:19.521825 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec521c93-d9b7-45c8-a550-a9492d30c20c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:19.522755 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec521c93-d9b7-45c8-a550-a9492d30c20c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:19.523374 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec521c93-d9b7-45c8-a550-a9492d30c20c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:19.523961 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec521c93-d9b7-45c8-a550-a9492d30c20c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:19.577665 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ec521c93-d9b7-45c8-a550-a9492d30c20c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070300 Sep 06 21:30:19.583517 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 676/1363] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:30:19 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:30:19.801179 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-1507fadd-662c-4ff3-a43a-133c18bf4fe3 req-2ab7674f-a47e-49ee-aef9-16f5c177b4af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65014e74-e05a-4c89-ad8b-ec4bab8b9bf4", "tag": "c91372e9-966e-469c-bdfc-85d1774fc70b"}, {"server_uuid": "d9c7094f-8cdb-4851-bd30-2aba5f98acc5", "name": "network-vif-deleted", "tag": "6f854815-005a-4c8f-8df3-38da0e771bab"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:30:19.813131 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1507fadd-662c-4ff3-a43a-133c18bf4fe3 req-2ab7674f-a47e-49ee-aef9-16f5c177b4af service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:19.813131 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1507fadd-662c-4ff3-a43a-133c18bf4fe3 req-2ab7674f-a47e-49ee-aef9-16f5c177b4af service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:19.813749 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1507fadd-662c-4ff3-a43a-133c18bf4fe3 req-2ab7674f-a47e-49ee-aef9-16f5c177b4af service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:19.827409 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-1507fadd-662c-4ff3-a43a-133c18bf4fe3 req-2ab7674f-a47e-49ee-aef9-16f5c177b4af service nova] Creating event network-changed:c91372e9-966e-469c-bdfc-85d1774fc70b for instance 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 on hv-cinder-74915 Sep 06 21:30:19.828058 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-1507fadd-662c-4ff3-a43a-133c18bf4fe3 req-2ab7674f-a47e-49ee-aef9-16f5c177b4af service nova] Creating event network-vif-deleted:6f854815-005a-4c8f-8df3-38da0e771bab for instance d9c7094f-8cdb-4851-bd30-2aba5f98acc5 on hv-cinder-74915 Sep 06 21:30:19.835041 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-1507fadd-662c-4ff3-a43a-133c18bf4fe3 req-2ab7674f-a47e-49ee-aef9-16f5c177b4af service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.039054 Sep 06 21:30:19.835934 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 688/1364] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:30:20.070773 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4fe23cb6-ad85-4697-ab54-2a30fd507140 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:30:20.072432 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4fe23cb6-ad85-4697-ab54-2a30fd507140 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: d9c7094f-8cdb-4851-bd30-2aba5f98acc5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:30:20.082043 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fe23cb6-ad85-4697-ab54-2a30fd507140 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:20.088209 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fe23cb6-ad85-4697-ab54-2a30fd507140 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:20.088862 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fe23cb6-ad85-4697-ab54-2a30fd507140 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:20.091362 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fe23cb6-ad85-4697-ab54-2a30fd507140 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:20.092595 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fe23cb6-ad85-4697-ab54-2a30fd507140 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:20.094559 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fe23cb6-ad85-4697-ab54-2a30fd507140 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:20.221823 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4fe23cb6-ad85-4697-ab54-2a30fd507140 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22472efcb9a454688744457cb45eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0b63bd9224370b45e7cc5e9c68a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:30:20.230302 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4fe23cb6-ad85-4697-ab54-2a30fd507140 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5" status: 200 len: 1326 microversion: 2.1 time: 0.163778 Sep 06 21:30:20.247580 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 677/1365] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:30:20 2022] GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5 => generated 1326 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 21:30:20.594818 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-795df21b-66d0-4d2f-ae26-b15cd32e3a94 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:30:20.597341 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-795df21b-66d0-4d2f-ae26-b15cd32e3a94 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:30:20.605614 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-795df21b-66d0-4d2f-ae26-b15cd32e3a94 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:20.606095 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-795df21b-66d0-4d2f-ae26-b15cd32e3a94 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:20.611822 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-795df21b-66d0-4d2f-ae26-b15cd32e3a94 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:20.613543 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-795df21b-66d0-4d2f-ae26-b15cd32e3a94 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:20.614193 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-795df21b-66d0-4d2f-ae26-b15cd32e3a94 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:20.614983 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-795df21b-66d0-4d2f-ae26-b15cd32e3a94 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:20.672649 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-795df21b-66d0-4d2f-ae26-b15cd32e3a94 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076714 Sep 06 21:30:20.673943 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 689/1366] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:30:20 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:30:21.255677 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3c253229-8327-49e9-b1f3-ae94162e48ed tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:30:21.256277 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3c253229-8327-49e9-b1f3-ae94162e48ed tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: d9c7094f-8cdb-4851-bd30-2aba5f98acc5] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:30:21.263201 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c253229-8327-49e9-b1f3-ae94162e48ed tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:21.263672 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c253229-8327-49e9-b1f3-ae94162e48ed tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:21.264094 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c253229-8327-49e9-b1f3-ae94162e48ed tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:21.264802 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c253229-8327-49e9-b1f3-ae94162e48ed tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:21.265255 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c253229-8327-49e9-b1f3-ae94162e48ed tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:21.265665 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c253229-8327-49e9-b1f3-ae94162e48ed tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:21.280106 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-3c253229-8327-49e9-b1f3-ae94162e48ed tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] HTTP exception thrown: Instance d9c7094f-8cdb-4851-bd30-2aba5f98acc5 could not be found. Sep 06 21:30:21.281785 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3c253229-8327-49e9-b1f3-ae94162e48ed tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Request method failure captured: Sep 06 21:30:21.281785 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5 HTTP/1.1 Sep 06 21:30:21.281785 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 06 21:30:21.281785 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 06 21:30:21.281785 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Connection: close Sep 06 21:30:21.281785 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 06 21:30:21.281785 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 06 21:30:21.281785 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Host: 10.222.0.79 Sep 06 21:30:21.281785 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 06 21:30:21.281785 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 06 21:30:21.281785 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjF7oBRUaWFmUaRMRrY2lmG27XTCe8m7oOenu15JckXMhNFYDIb6s6CTPHxEIINys886U3nqIXNvhOhvtXDn-W2TtU1LkNmSf6teGC7l2Pr1U-HL4_5PeX8X3jMoeu0l-wC_3RYNggU9GitVP5pFTsCQ7cQZQ9cQw1uf_6XEJXvRawCjA Sep 06 21:30:21.281785 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 06 21:30:21.281785 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 06 21:30:21.281785 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 06 21:30:21.281785 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 06 21:30:21.281785 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 06 21:30:21.281785 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 06 21:30:21.281785 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Id: 0ca0b63bd9224370b45e7cc5e9c68a27 Sep 06 21:30:21.281785 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:30:21.281785 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Role: reader,member Sep 06 21:30:21.281785 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Sep 06 21:30:21.283489 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0ca0b63bd9224370b45e7cc5e9c68a27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0ca0b63bd9224370b45e7cc5e9c68a27", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ca0b63bd9224370b45e7cc5e9c68a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ca0b63bd9224370b45e7cc5e9c68a27"}]}] Sep 06 21:30:21.283489 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:30:21.283489 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 0ca0b63bd9224370b45e7cc5e9c68a27 Sep 06 21:30:21.283489 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:30:21.283489 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-1682827976-project Sep 06 21:30:21.283489 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 06 21:30:21.283489 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 06 21:30:21.283489 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Id: e22472efcb9a454688744457cb45eabb Sep 06 21:30:21.283489 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-1682827976-project Sep 06 21:30:21.283489 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: method: > Sep 06 21:30:21.283489 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: exception: Instance d9c7094f-8cdb-4851-bd30-2aba5f98acc5 could not be found. Sep 06 21:30:21.283489 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: action_args: {'id': 'd9c7094f-8cdb-4851-bd30-2aba5f98acc5'} Sep 06 21:30:21.284804 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:30:21.284804 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:21.284804 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:30:21.284804 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:30:21.284804 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:30:21.284804 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:30:21.284804 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:30:21.284804 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:30:21.284804 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:30:21.284804 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:30:21.284804 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9c7094f-8cdb-4851-bd30-2aba5f98acc5 could not be found. Sep 06 21:30:21.284804 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:30:21.284804 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:30:21.284804 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:30:21.284804 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:21.284804 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:30:21.284804 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:30:21.284804 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:30:21.284804 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:30:21.284804 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:30:21.287670 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:30:21.287670 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:30:21.287670 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:30:21.287670 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:30:21.287670 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:30:21.287670 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:30:21.287670 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:30:21.287670 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9c7094f-8cdb-4851-bd30-2aba5f98acc5 could not be found. Sep 06 21:30:21.287670 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:30:21.287670 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:30:21.287670 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:30:21.287670 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:21.287670 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:30:21.287670 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:30:21.287670 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:30:21.287670 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:30:21.287670 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9c7094f-8cdb-4851-bd30-2aba5f98acc5 could not be found. Sep 06 21:30:21.287670 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:30:21.289587 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3c253229-8327-49e9-b1f3-ae94162e48ed tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Returning 404 to user: Instance d9c7094f-8cdb-4851-bd30-2aba5f98acc5 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:30:21.289587 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3c253229-8327-49e9-b1f3-ae94162e48ed tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5" status: 404 len: 111 microversion: 2.1 time: 0.031553 Sep 06 21:30:21.289587 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 678/1367] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:30:21 2022] GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:30:21.294319 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f80ca2d9-aff0-436f-99fd-425c86916e65 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '.version_select at 0x7f04ce8f81f0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:30:21.316519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f80ca2d9-aff0-436f-99fd-425c86916e65 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1854038291" status: 202 len: 0 microversion: 2.1 time: 0.026342 Sep 06 21:30:21.317153 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 690/1368] 10.222.0.79 () {58 vars in 1221 bytes} [Tue Sep 6 21:30:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1854038291 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 21:30:21.685837 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-da2c2090-f02f-4f41-9643-7d880f473269 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:30:21.688171 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-da2c2090-f02f-4f41-9643-7d880f473269 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:30:21.694451 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da2c2090-f02f-4f41-9643-7d880f473269 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:21.695126 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da2c2090-f02f-4f41-9643-7d880f473269 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:21.695794 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da2c2090-f02f-4f41-9643-7d880f473269 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:21.696500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da2c2090-f02f-4f41-9643-7d880f473269 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:21.696986 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da2c2090-f02f-4f41-9643-7d880f473269 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:21.697405 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da2c2090-f02f-4f41-9643-7d880f473269 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:21.727082 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-da2c2090-f02f-4f41-9643-7d880f473269 tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045278 Sep 06 21:30:21.727632 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 679/1369] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Sep 6 21:30:21 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 21:30:21.739166 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c6b3dfe7-e142-44d1-9092-e7792cda7caf tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:30:21.739680 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c6b3dfe7-e142-44d1-9092-e7792cda7caf tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:30:21.747468 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6b3dfe7-e142-44d1-9092-e7792cda7caf tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:21.747950 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6b3dfe7-e142-44d1-9092-e7792cda7caf tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:21.748385 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6b3dfe7-e142-44d1-9092-e7792cda7caf tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:21.749097 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6b3dfe7-e142-44d1-9092-e7792cda7caf tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:21.749552 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6b3dfe7-e142-44d1-9092-e7792cda7caf tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:21.749970 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6b3dfe7-e142-44d1-9092-e7792cda7caf tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:21.826282 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-c6b3dfe7-e142-44d1-9092-e7792cda7caf tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] HTTP exception thrown: Instance 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 is not attached to volume 601755c2-67ab-4a32-aa7e-5f32adf15a2f Sep 06 21:30:21.828724 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c6b3dfe7-e142-44d1-9092-e7792cda7caf tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Request method failure captured: Sep 06 21:30:21.828724 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4/os-volume_attachments/601755c2-67ab-4a32-aa7e-5f32adf15a2f HTTP/1.1 Sep 06 21:30:21.828724 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:30:21.828724 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:30:21.828724 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:30:21.828724 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:30:21.828724 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:30:21.828724 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:30:21.828724 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:30:21.828724 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:30:21.828724 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7sotMo77B6CcTJ3FOW_hDUv1m4WjtSZU_YA7Y5SKjLqB_QO7vgRNm0csmB0hW_uBUg8Ia9qdE6_1wRkV_LlALwcvj0YcZIJSODInyM4AbhETq6b1eldXFyhG60y3MTEJna5cxqZJoz-6IW6FqvnML3eAHeEr4KnzSeDk8IXrdTJxd4 Sep 06 21:30:21.828724 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:30:21.828724 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:30:21.828724 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:30:21.828724 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:30:21.828724 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:30:21.828724 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:30:21.828724 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: ca88b1d59a924130a3fa43b0b256c33e Sep 06 21:30:21.828724 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-TestMinimumBasicScenario-459554959 Sep 06 21:30:21.828724 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:30:21.828724 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:30:21.830519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ca88b1d59a924130a3fa43b0b256c33e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ca88b1d59a924130a3fa43b0b256c33e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca88b1d59a924130a3fa43b0b256c33e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca88b1d59a924130a3fa43b0b256c33e"}]}] Sep 06 21:30:21.830519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-TestMinimumBasicScenario-459554959 Sep 06 21:30:21.830519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: ca88b1d59a924130a3fa43b0b256c33e Sep 06 21:30:21.830519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestMinimumBasicScenario-459554959 Sep 06 21:30:21.830519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-TestMinimumBasicScenario-459554959-project Sep 06 21:30:21.830519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:30:21.830519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:30:21.830519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: d52264275fdb411484cfc6b39b625d8b Sep 06 21:30:21.830519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-TestMinimumBasicScenario-459554959-project Sep 06 21:30:21.830519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: > Sep 06 21:30:21.830519 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Instance 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 is not attached to volume 601755c2-67ab-4a32-aa7e-5f32adf15a2f Sep 06 21:30:21.831394 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'server_id': '65014e74-e05a-4c89-ad8b-ec4bab8b9bf4', 'id': '601755c2-67ab-4a32-aa7e-5f32adf15a2f'} Sep 06 21:30:21.831394 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:30:21.831394 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:21.831394 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 06 21:30:21.831394 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 06 21:30:21.831394 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 21:30:21.831394 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 21:30:21.831394 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 06 21:30:21.831394 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 06 21:30:21.831394 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 601755c2-67ab-4a32-aa7e-5f32adf15a2f. Sep 06 21:30:21.831394 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:30:21.831394 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:30:21.831394 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:30:21.831394 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:21.831394 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:30:21.831394 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:30:21.831394 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:30:21.831394 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:30:21.831394 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:30:21.832929 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:30:21.832929 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 06 21:30:21.832929 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 06 21:30:21.832929 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 is not attached to volume 601755c2-67ab-4a32-aa7e-5f32adf15a2f Sep 06 21:30:21.832929 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:30:21.832929 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:30:21.832929 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:30:21.832929 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:21.832929 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:30:21.832929 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:30:21.832929 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:30:21.832929 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:30:21.832929 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 is not attached to volume 601755c2-67ab-4a32-aa7e-5f32adf15a2f Sep 06 21:30:21.832929 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:30:21.832929 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c6b3dfe7-e142-44d1-9092-e7792cda7caf tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Returning 404 to user: Instance 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 is not attached to volume 601755c2-67ab-4a32-aa7e-5f32adf15a2f {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:30:21.834091 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c6b3dfe7-e142-44d1-9092-e7792cda7caf tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "DELETE /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4/os-volume_attachments/601755c2-67ab-4a32-aa7e-5f32adf15a2f" status: 404 len: 154 microversion: 2.1 time: 0.095963 Sep 06 21:30:21.834091 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 691/1370] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Sep 6 21:30:21 2022] DELETE /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4/os-volume_attachments/601755c2-67ab-4a32-aa7e-5f32adf15a2f => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:30:22.985938 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c894a2b9-cf4d-453f-aa5f-ae622632446c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:30:22.986514 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c894a2b9-cf4d-453f-aa5f-ae622632446c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:30:22.994101 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c894a2b9-cf4d-453f-aa5f-ae622632446c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:22.994638 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c894a2b9-cf4d-453f-aa5f-ae622632446c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:22.995085 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c894a2b9-cf4d-453f-aa5f-ae622632446c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:22.995820 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c894a2b9-cf4d-453f-aa5f-ae622632446c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:22.996284 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c894a2b9-cf4d-453f-aa5f-ae622632446c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:22.996888 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c894a2b9-cf4d-453f-aa5f-ae622632446c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:23.027641 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c894a2b9-cf4d-453f-aa5f-ae622632446c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 21:30:23.083597 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4287fff0-339f-4d8f-bdc0-21a325d1456c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:30:23.084258 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4287fff0-339f-4d8f-bdc0-21a325d1456c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: d9c7094f-8cdb-4851-bd30-2aba5f98acc5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:30:23.091739 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4287fff0-339f-4d8f-bdc0-21a325d1456c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:23.092945 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4287fff0-339f-4d8f-bdc0-21a325d1456c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:23.093378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4287fff0-339f-4d8f-bdc0-21a325d1456c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:23.094157 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4287fff0-339f-4d8f-bdc0-21a325d1456c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:23.094597 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4287fff0-339f-4d8f-bdc0-21a325d1456c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:23.095023 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4287fff0-339f-4d8f-bdc0-21a325d1456c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:23.112010 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c894a2b9-cf4d-453f-aa5f-ae622632446c tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "DELETE /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 204 len: 0 microversion: 2.1 time: 0.131216 Sep 06 21:30:23.112252 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-4287fff0-339f-4d8f-bdc0-21a325d1456c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] HTTP exception thrown: Instance d9c7094f-8cdb-4851-bd30-2aba5f98acc5 could not be found. Sep 06 21:30:23.112701 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 680/1371] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Sep 6 21:30:22 2022] DELETE /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 21:30:23.113935 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4287fff0-339f-4d8f-bdc0-21a325d1456c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Request method failure captured: Sep 06 21:30:23.113935 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5 HTTP/1.1 Sep 06 21:30:23.113935 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:30:23.113935 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:30:23.113935 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:30:23.113935 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:30:23.113935 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:30:23.113935 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:30:23.113935 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:30:23.113935 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:30:23.113935 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7oBRUaWFmUaRMRrY2lmG27XTCe8m7oOenu15JckXMhNFYDIb6s6CTPHxEIINys886U3nqIXNvhOhvtXDn-W2TtU1LkNmSf6teGC7l2Pr1U-HL4_5PeX8X3jMoeu0l-wC_3RYNggU9GitVP5pFTsCQ7cQZQ9cQw1uf_6XEJXvRawCjA Sep 06 21:30:23.113935 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:30:23.113935 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:30:23.113935 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:30:23.113935 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:30:23.113935 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:30:23.113935 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:30:23.113935 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: 0ca0b63bd9224370b45e7cc5e9c68a27 Sep 06 21:30:23.113935 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:30:23.113935 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:30:23.113935 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:30:23.115709 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0ca0b63bd9224370b45e7cc5e9c68a27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0ca0b63bd9224370b45e7cc5e9c68a27", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ca0b63bd9224370b45e7cc5e9c68a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ca0b63bd9224370b45e7cc5e9c68a27"}]}] Sep 06 21:30:23.115709 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:30:23.115709 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 0ca0b63bd9224370b45e7cc5e9c68a27 Sep 06 21:30:23.115709 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:30:23.115709 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeNegativeTest-1682827976-project Sep 06 21:30:23.115709 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:30:23.115709 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:30:23.115709 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: e22472efcb9a454688744457cb45eabb Sep 06 21:30:23.115709 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeNegativeTest-1682827976-project Sep 06 21:30:23.115709 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: > Sep 06 21:30:23.115709 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Instance d9c7094f-8cdb-4851-bd30-2aba5f98acc5 could not be found. Sep 06 21:30:23.115709 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'id': 'd9c7094f-8cdb-4851-bd30-2aba5f98acc5'} Sep 06 21:30:23.116691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:30:23.116691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:23.116691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:30:23.116691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:30:23.116691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:30:23.116691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:30:23.116691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:30:23.116691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:30:23.116691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:30:23.116691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:30:23.116691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9c7094f-8cdb-4851-bd30-2aba5f98acc5 could not be found. Sep 06 21:30:23.116691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:30:23.116691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:30:23.116691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:30:23.116691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:23.116691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:30:23.116691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:30:23.116691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:30:23.116691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:30:23.116691 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:30:23.118339 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:30:23.118339 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 21:30:23.118339 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 21:30:23.118339 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 21:30:23.118339 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 21:30:23.118339 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:30:23.118339 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:30:23.118339 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:30:23.118339 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:30:23.118339 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9c7094f-8cdb-4851-bd30-2aba5f98acc5 could not be found. Sep 06 21:30:23.118339 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:30:23.118339 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:30:23.118339 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:30:23.118339 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:23.118339 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:30:23.118339 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:30:23.118339 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:30:23.118339 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:30:23.118339 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9c7094f-8cdb-4851-bd30-2aba5f98acc5 could not be found. Sep 06 21:30:23.118339 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:30:23.119992 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4287fff0-339f-4d8f-bdc0-21a325d1456c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Returning 404 to user: Instance d9c7094f-8cdb-4851-bd30-2aba5f98acc5 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:30:23.119992 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4287fff0-339f-4d8f-bdc0-21a325d1456c tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5" status: 404 len: 111 microversion: 2.1 time: 0.035908 Sep 06 21:30:23.119992 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 692/1372] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Sep 6 21:30:23 2022] DELETE /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:30:23.126185 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f997c96c-c65e-4580-8b79-a45603da16bc tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:30:23.126779 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e296dffa-d8d7-40dc-9327-d21a58c5fc17 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:30:23.126985 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f997c96c-c65e-4580-8b79-a45603da16bc tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:30:23.127496 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e296dffa-d8d7-40dc-9327-d21a58c5fc17 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: d9c7094f-8cdb-4851-bd30-2aba5f98acc5] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:30:23.133242 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f997c96c-c65e-4580-8b79-a45603da16bc tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:23.133725 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f997c96c-c65e-4580-8b79-a45603da16bc tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:23.133899 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e296dffa-d8d7-40dc-9327-d21a58c5fc17 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:23.134156 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f997c96c-c65e-4580-8b79-a45603da16bc tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:23.134328 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e296dffa-d8d7-40dc-9327-d21a58c5fc17 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:23.134643 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e296dffa-d8d7-40dc-9327-d21a58c5fc17 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:23.134833 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f997c96c-c65e-4580-8b79-a45603da16bc tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:23.135303 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f997c96c-c65e-4580-8b79-a45603da16bc tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:23.135466 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e296dffa-d8d7-40dc-9327-d21a58c5fc17 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:23.135726 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f997c96c-c65e-4580-8b79-a45603da16bc tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:23.135879 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e296dffa-d8d7-40dc-9327-d21a58c5fc17 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:23.136164 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e296dffa-d8d7-40dc-9327-d21a58c5fc17 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:23.149783 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-e296dffa-d8d7-40dc-9327-d21a58c5fc17 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] HTTP exception thrown: Instance d9c7094f-8cdb-4851-bd30-2aba5f98acc5 could not be found. Sep 06 21:30:23.151332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e296dffa-d8d7-40dc-9327-d21a58c5fc17 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Request method failure captured: Sep 06 21:30:23.151332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5 HTTP/1.1 Sep 06 21:30:23.151332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:30:23.151332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:30:23.151332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:30:23.151332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:30:23.151332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:30:23.151332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:30:23.151332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:30:23.151332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:30:23.151332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7oBRUaWFmUaRMRrY2lmG27XTCe8m7oOenu15JckXMhNFYDIb6s6CTPHxEIINys886U3nqIXNvhOhvtXDn-W2TtU1LkNmSf6teGC7l2Pr1U-HL4_5PeX8X3jMoeu0l-wC_3RYNggU9GitVP5pFTsCQ7cQZQ9cQw1uf_6XEJXvRawCjA Sep 06 21:30:23.151332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:30:23.151332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:30:23.151332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:30:23.151332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:30:23.151332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:30:23.151332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:30:23.151332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: 0ca0b63bd9224370b45e7cc5e9c68a27 Sep 06 21:30:23.151332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:30:23.151332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:30:23.151332 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:30:23.153110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0ca0b63bd9224370b45e7cc5e9c68a27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0ca0b63bd9224370b45e7cc5e9c68a27", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ca0b63bd9224370b45e7cc5e9c68a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ca0b63bd9224370b45e7cc5e9c68a27"}]}] Sep 06 21:30:23.153110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:30:23.153110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 0ca0b63bd9224370b45e7cc5e9c68a27 Sep 06 21:30:23.153110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:30:23.153110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeNegativeTest-1682827976-project Sep 06 21:30:23.153110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:30:23.153110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:30:23.153110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: e22472efcb9a454688744457cb45eabb Sep 06 21:30:23.153110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeNegativeTest-1682827976-project Sep 06 21:30:23.153110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: > Sep 06 21:30:23.153110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Instance d9c7094f-8cdb-4851-bd30-2aba5f98acc5 could not be found. Sep 06 21:30:23.153110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'id': 'd9c7094f-8cdb-4851-bd30-2aba5f98acc5'} Sep 06 21:30:23.154110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:30:23.154110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:23.154110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:30:23.154110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:30:23.154110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:30:23.154110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:30:23.154110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:30:23.154110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:30:23.154110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:30:23.154110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:30:23.154110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9c7094f-8cdb-4851-bd30-2aba5f98acc5 could not be found. Sep 06 21:30:23.154110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:30:23.154110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:30:23.154110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:30:23.154110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:23.154110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:30:23.154110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:30:23.154110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:30:23.154110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:30:23.154110 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:30:23.155683 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:30:23.155683 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:30:23.155683 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:30:23.155683 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:30:23.155683 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:30:23.155683 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:30:23.155683 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:30:23.155683 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9c7094f-8cdb-4851-bd30-2aba5f98acc5 could not be found. Sep 06 21:30:23.155683 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:30:23.155683 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:30:23.155683 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:30:23.155683 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:23.155683 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:30:23.155683 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:30:23.155683 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:30:23.155683 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:30:23.155683 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9c7094f-8cdb-4851-bd30-2aba5f98acc5 could not be found. Sep 06 21:30:23.155683 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:30:23.157357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e296dffa-d8d7-40dc-9327-d21a58c5fc17 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Returning 404 to user: Instance d9c7094f-8cdb-4851-bd30-2aba5f98acc5 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:30:23.157357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e296dffa-d8d7-40dc-9327-d21a58c5fc17 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5" status: 404 len: 111 microversion: 2.1 time: 0.031165 Sep 06 21:30:23.157357 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 693/1373] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:30:23 2022] GET /compute/v2.1/servers/d9c7094f-8cdb-4851-bd30-2aba5f98acc5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:30:23.272993 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f997c96c-c65e-4580-8b79-a45603da16bc tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:30:23.281478 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f997c96c-c65e-4580-8b79-a45603da16bc tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1554 microversion: 2.1 time: 0.159444 Sep 06 21:30:23.282174 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 681/1374] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:30:23 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:30:24.305549 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-652abe33-1dbd-4c04-b0ee-4ec10d46c7ba tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:30:24.306465 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-652abe33-1dbd-4c04-b0ee-4ec10d46c7ba tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:30:24.307144 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-36f9cc90-4e0c-4b06-9a2d-320249cf66ce tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:30:24.307750 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-36f9cc90-4e0c-4b06-9a2d-320249cf66ce tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:30:24.313792 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-652abe33-1dbd-4c04-b0ee-4ec10d46c7ba tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:24.314308 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-652abe33-1dbd-4c04-b0ee-4ec10d46c7ba tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:24.314910 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-652abe33-1dbd-4c04-b0ee-4ec10d46c7ba tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:24.315577 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-652abe33-1dbd-4c04-b0ee-4ec10d46c7ba tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:24.316055 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-652abe33-1dbd-4c04-b0ee-4ec10d46c7ba tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:24.316695 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-652abe33-1dbd-4c04-b0ee-4ec10d46c7ba tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:24.318843 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36f9cc90-4e0c-4b06-9a2d-320249cf66ce tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:24.319420 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36f9cc90-4e0c-4b06-9a2d-320249cf66ce tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:24.319890 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36f9cc90-4e0c-4b06-9a2d-320249cf66ce tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:24.321046 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36f9cc90-4e0c-4b06-9a2d-320249cf66ce tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:24.322934 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36f9cc90-4e0c-4b06-9a2d-320249cf66ce tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:24.322934 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36f9cc90-4e0c-4b06-9a2d-320249cf66ce tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:24.341856 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-36f9cc90-4e0c-4b06-9a2d-320249cf66ce tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] HTTP exception thrown: Instance 03eaf3bf-fadc-452d-97c1-7faa2414a36a could not be found. Sep 06 21:30:24.343973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-36f9cc90-4e0c-4b06-9a2d-320249cf66ce tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Request method failure captured: Sep 06 21:30:24.343973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a HTTP/1.1 Sep 06 21:30:24.343973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 06 21:30:24.343973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 06 21:30:24.343973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Connection: close Sep 06 21:30:24.343973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 06 21:30:24.343973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 06 21:30:24.343973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Host: 10.222.0.79 Sep 06 21:30:24.343973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 06 21:30:24.343973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 06 21:30:24.343973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjF7oBRUaWFmUaRMRrY2lmG27XTCe8m7oOenu15JckXMhNFYDIb6s6CTPHxEIINys886U3nqIXNvhOhvtXDn-W2TtU1LkNmSf6teGC7l2Pr1U-HL4_5PeX8X3jMoeu0l-wC_3RYNggU9GitVP5pFTsCQ7cQZQ9cQw1uf_6XEJXvRawCjA Sep 06 21:30:24.343973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 06 21:30:24.343973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 06 21:30:24.343973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 06 21:30:24.343973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 06 21:30:24.343973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 06 21:30:24.343973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 06 21:30:24.343973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Id: 0ca0b63bd9224370b45e7cc5e9c68a27 Sep 06 21:30:24.343973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:30:24.343973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Role: reader,member Sep 06 21:30:24.343973 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Sep 06 21:30:24.345784 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0ca0b63bd9224370b45e7cc5e9c68a27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0ca0b63bd9224370b45e7cc5e9c68a27", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ca0b63bd9224370b45e7cc5e9c68a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ca0b63bd9224370b45e7cc5e9c68a27"}]}] Sep 06 21:30:24.345784 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:30:24.345784 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 0ca0b63bd9224370b45e7cc5e9c68a27 Sep 06 21:30:24.345784 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:30:24.345784 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-1682827976-project Sep 06 21:30:24.345784 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 06 21:30:24.345784 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 06 21:30:24.345784 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Id: e22472efcb9a454688744457cb45eabb Sep 06 21:30:24.345784 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-1682827976-project Sep 06 21:30:24.345784 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: method: > Sep 06 21:30:24.345784 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: exception: Instance 03eaf3bf-fadc-452d-97c1-7faa2414a36a could not be found. Sep 06 21:30:24.345784 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: action_args: {'id': '03eaf3bf-fadc-452d-97c1-7faa2414a36a'} Sep 06 21:30:24.346793 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:30:24.346793 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:24.346793 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:30:24.346793 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:30:24.346793 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:30:24.346793 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:30:24.346793 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:30:24.346793 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:30:24.346793 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:30:24.346793 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:30:24.346793 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03eaf3bf-fadc-452d-97c1-7faa2414a36a could not be found. Sep 06 21:30:24.346793 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:30:24.346793 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:30:24.346793 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:30:24.346793 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:24.346793 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:30:24.346793 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:30:24.346793 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:30:24.346793 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:30:24.346793 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:30:24.348353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:30:24.348353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 21:30:24.348353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 21:30:24.348353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 21:30:24.348353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 21:30:24.348353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:30:24.348353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:30:24.348353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:30:24.348353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:30:24.348353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03eaf3bf-fadc-452d-97c1-7faa2414a36a could not be found. Sep 06 21:30:24.348353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:30:24.348353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:30:24.348353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:30:24.348353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:24.348353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:30:24.348353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:30:24.348353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:30:24.348353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:30:24.348353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03eaf3bf-fadc-452d-97c1-7faa2414a36a could not be found. Sep 06 21:30:24.348353 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:30:24.350011 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-36f9cc90-4e0c-4b06-9a2d-320249cf66ce tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Returning 404 to user: Instance 03eaf3bf-fadc-452d-97c1-7faa2414a36a could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:30:24.350011 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-36f9cc90-4e0c-4b06-9a2d-320249cf66ce tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "DELETE /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a" status: 404 len: 111 microversion: 2.1 time: 0.042959 Sep 06 21:30:24.350011 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 682/1375] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Sep 6 21:30:24 2022] DELETE /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:30:24.354507 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-da659211-1470-41f2-b339-49cc7d25a61b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:30:24.355112 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-da659211-1470-41f2-b339-49cc7d25a61b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 03eaf3bf-fadc-452d-97c1-7faa2414a36a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:30:24.361234 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da659211-1470-41f2-b339-49cc7d25a61b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:24.361702 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da659211-1470-41f2-b339-49cc7d25a61b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:24.362124 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da659211-1470-41f2-b339-49cc7d25a61b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:24.362815 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da659211-1470-41f2-b339-49cc7d25a61b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:24.363247 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da659211-1470-41f2-b339-49cc7d25a61b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:24.363661 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da659211-1470-41f2-b339-49cc7d25a61b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:24.379746 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-da659211-1470-41f2-b339-49cc7d25a61b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] HTTP exception thrown: Instance 03eaf3bf-fadc-452d-97c1-7faa2414a36a could not be found. Sep 06 21:30:24.381500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-da659211-1470-41f2-b339-49cc7d25a61b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Request method failure captured: Sep 06 21:30:24.381500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a HTTP/1.1 Sep 06 21:30:24.381500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 06 21:30:24.381500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 06 21:30:24.381500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Connection: close Sep 06 21:30:24.381500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 06 21:30:24.381500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 06 21:30:24.381500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Host: 10.222.0.79 Sep 06 21:30:24.381500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 06 21:30:24.381500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 06 21:30:24.381500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjF7oBRUaWFmUaRMRrY2lmG27XTCe8m7oOenu15JckXMhNFYDIb6s6CTPHxEIINys886U3nqIXNvhOhvtXDn-W2TtU1LkNmSf6teGC7l2Pr1U-HL4_5PeX8X3jMoeu0l-wC_3RYNggU9GitVP5pFTsCQ7cQZQ9cQw1uf_6XEJXvRawCjA Sep 06 21:30:24.381500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 06 21:30:24.381500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 06 21:30:24.381500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 06 21:30:24.381500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 06 21:30:24.381500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 06 21:30:24.381500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 06 21:30:24.381500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Id: 0ca0b63bd9224370b45e7cc5e9c68a27 Sep 06 21:30:24.381500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:30:24.381500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Role: reader,member Sep 06 21:30:24.381500 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Sep 06 21:30:24.383252 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0ca0b63bd9224370b45e7cc5e9c68a27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0ca0b63bd9224370b45e7cc5e9c68a27", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ca0b63bd9224370b45e7cc5e9c68a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ca0b63bd9224370b45e7cc5e9c68a27"}]}] Sep 06 21:30:24.383252 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:30:24.383252 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 0ca0b63bd9224370b45e7cc5e9c68a27 Sep 06 21:30:24.383252 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:30:24.383252 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-1682827976-project Sep 06 21:30:24.383252 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 06 21:30:24.383252 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 06 21:30:24.383252 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Id: e22472efcb9a454688744457cb45eabb Sep 06 21:30:24.383252 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-1682827976-project Sep 06 21:30:24.383252 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: method: > Sep 06 21:30:24.383252 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: exception: Instance 03eaf3bf-fadc-452d-97c1-7faa2414a36a could not be found. Sep 06 21:30:24.383252 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: action_args: {'id': '03eaf3bf-fadc-452d-97c1-7faa2414a36a'} Sep 06 21:30:24.384232 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:30:24.384232 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:24.384232 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:30:24.384232 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:30:24.384232 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:30:24.384232 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:30:24.384232 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:30:24.384232 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:30:24.384232 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:30:24.384232 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:30:24.384232 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03eaf3bf-fadc-452d-97c1-7faa2414a36a could not be found. Sep 06 21:30:24.384232 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:30:24.384232 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:30:24.384232 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:30:24.384232 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:24.384232 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:30:24.384232 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:30:24.384232 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:30:24.384232 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:30:24.384232 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:30:24.385802 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:30:24.385802 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:30:24.385802 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:30:24.385802 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:30:24.385802 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:30:24.385802 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:30:24.385802 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:30:24.385802 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03eaf3bf-fadc-452d-97c1-7faa2414a36a could not be found. Sep 06 21:30:24.385802 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:30:24.385802 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:30:24.385802 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:30:24.385802 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:24.385802 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:30:24.385802 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:30:24.385802 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:30:24.385802 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:30:24.385802 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03eaf3bf-fadc-452d-97c1-7faa2414a36a could not be found. Sep 06 21:30:24.385802 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:30:24.387237 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-da659211-1470-41f2-b339-49cc7d25a61b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Returning 404 to user: Instance 03eaf3bf-fadc-452d-97c1-7faa2414a36a could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:30:24.387810 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-da659211-1470-41f2-b339-49cc7d25a61b tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a" status: 404 len: 111 microversion: 2.1 time: 0.037462 Sep 06 21:30:24.388585 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 683/1376] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:30:24 2022] GET /compute/v2.1/servers/03eaf3bf-fadc-452d-97c1-7faa2414a36a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:30:24.399601 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ed06acdb-ecc3-40a8-b623-d1e755d793db tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:30:24.400115 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ed06acdb-ecc3-40a8-b623-d1e755d793db tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 17b54989-ef84-453f-920e-766847e1d0ed] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:30:24.406231 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed06acdb-ecc3-40a8-b623-d1e755d793db tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:24.406712 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed06acdb-ecc3-40a8-b623-d1e755d793db tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:24.407151 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed06acdb-ecc3-40a8-b623-d1e755d793db tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:24.407858 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed06acdb-ecc3-40a8-b623-d1e755d793db tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:24.408294 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed06acdb-ecc3-40a8-b623-d1e755d793db tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:24.408741 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed06acdb-ecc3-40a8-b623-d1e755d793db tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:24.423860 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-ed06acdb-ecc3-40a8-b623-d1e755d793db tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] HTTP exception thrown: Instance 17b54989-ef84-453f-920e-766847e1d0ed could not be found. Sep 06 21:30:24.426051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ed06acdb-ecc3-40a8-b623-d1e755d793db tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Request method failure captured: Sep 06 21:30:24.426051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed HTTP/1.1 Sep 06 21:30:24.426051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 06 21:30:24.426051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 06 21:30:24.426051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Connection: close Sep 06 21:30:24.426051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 06 21:30:24.426051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 06 21:30:24.426051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Host: 10.222.0.79 Sep 06 21:30:24.426051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 06 21:30:24.426051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 06 21:30:24.426051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjF7oBRUaWFmUaRMRrY2lmG27XTCe8m7oOenu15JckXMhNFYDIb6s6CTPHxEIINys886U3nqIXNvhOhvtXDn-W2TtU1LkNmSf6teGC7l2Pr1U-HL4_5PeX8X3jMoeu0l-wC_3RYNggU9GitVP5pFTsCQ7cQZQ9cQw1uf_6XEJXvRawCjA Sep 06 21:30:24.426051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 06 21:30:24.426051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 06 21:30:24.426051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 06 21:30:24.426051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 06 21:30:24.426051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 06 21:30:24.426051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 06 21:30:24.426051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Id: 0ca0b63bd9224370b45e7cc5e9c68a27 Sep 06 21:30:24.426051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:30:24.426051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Role: reader,member Sep 06 21:30:24.426051 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Sep 06 21:30:24.430204 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0ca0b63bd9224370b45e7cc5e9c68a27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0ca0b63bd9224370b45e7cc5e9c68a27", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ca0b63bd9224370b45e7cc5e9c68a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ca0b63bd9224370b45e7cc5e9c68a27"}]}] Sep 06 21:30:24.430204 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:30:24.430204 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 0ca0b63bd9224370b45e7cc5e9c68a27 Sep 06 21:30:24.430204 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:30:24.430204 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-1682827976-project Sep 06 21:30:24.430204 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 06 21:30:24.430204 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 06 21:30:24.430204 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Id: e22472efcb9a454688744457cb45eabb Sep 06 21:30:24.430204 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-1682827976-project Sep 06 21:30:24.430204 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: method: > Sep 06 21:30:24.430204 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: exception: Instance 17b54989-ef84-453f-920e-766847e1d0ed could not be found. Sep 06 21:30:24.430204 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: action_args: {'id': '17b54989-ef84-453f-920e-766847e1d0ed'} Sep 06 21:30:24.431632 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:30:24.431632 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:24.431632 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:30:24.431632 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:30:24.431632 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:30:24.431632 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:30:24.431632 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:30:24.431632 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:30:24.431632 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:30:24.431632 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:30:24.431632 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17b54989-ef84-453f-920e-766847e1d0ed could not be found. Sep 06 21:30:24.431632 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:30:24.431632 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:30:24.431632 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:30:24.431632 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:24.431632 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:30:24.431632 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:30:24.431632 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:30:24.431632 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:30:24.431632 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:30:24.433256 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:30:24.433256 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 21:30:24.433256 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 21:30:24.433256 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 21:30:24.433256 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 21:30:24.433256 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:30:24.433256 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:30:24.433256 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:30:24.433256 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:30:24.433256 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17b54989-ef84-453f-920e-766847e1d0ed could not be found. Sep 06 21:30:24.433256 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:30:24.433256 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:30:24.433256 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:30:24.433256 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:24.433256 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:30:24.433256 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:30:24.433256 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:30:24.433256 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:30:24.433256 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17b54989-ef84-453f-920e-766847e1d0ed could not be found. Sep 06 21:30:24.433256 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:30:24.434661 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ed06acdb-ecc3-40a8-b623-d1e755d793db tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Returning 404 to user: Instance 17b54989-ef84-453f-920e-766847e1d0ed could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:30:24.434661 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ed06acdb-ecc3-40a8-b623-d1e755d793db tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "DELETE /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed" status: 404 len: 111 microversion: 2.1 time: 0.034412 Sep 06 21:30:24.434661 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 684/1377] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Sep 6 21:30:24 2022] DELETE /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 21:30:24.436382 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a52a1de3-52fe-4697-aee0-8784d52576bc tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:30:24.437023 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a52a1de3-52fe-4697-aee0-8784d52576bc tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 17b54989-ef84-453f-920e-766847e1d0ed] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:30:24.446077 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a52a1de3-52fe-4697-aee0-8784d52576bc tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:24.446693 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a52a1de3-52fe-4697-aee0-8784d52576bc tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:24.447069 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a52a1de3-52fe-4697-aee0-8784d52576bc tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:24.447695 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a52a1de3-52fe-4697-aee0-8784d52576bc tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:24.448147 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a52a1de3-52fe-4697-aee0-8784d52576bc tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:24.448571 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a52a1de3-52fe-4697-aee0-8784d52576bc tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:24.463044 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-a52a1de3-52fe-4697-aee0-8784d52576bc tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] HTTP exception thrown: Instance 17b54989-ef84-453f-920e-766847e1d0ed could not be found. Sep 06 21:30:24.465524 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a52a1de3-52fe-4697-aee0-8784d52576bc tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Request method failure captured: Sep 06 21:30:24.465524 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed HTTP/1.1 Sep 06 21:30:24.465524 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 06 21:30:24.465524 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 06 21:30:24.465524 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Connection: close Sep 06 21:30:24.465524 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 06 21:30:24.465524 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 06 21:30:24.465524 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Host: 10.222.0.79 Sep 06 21:30:24.465524 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 06 21:30:24.465524 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 06 21:30:24.465524 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjF7oBRUaWFmUaRMRrY2lmG27XTCe8m7oOenu15JckXMhNFYDIb6s6CTPHxEIINys886U3nqIXNvhOhvtXDn-W2TtU1LkNmSf6teGC7l2Pr1U-HL4_5PeX8X3jMoeu0l-wC_3RYNggU9GitVP5pFTsCQ7cQZQ9cQw1uf_6XEJXvRawCjA Sep 06 21:30:24.465524 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 06 21:30:24.465524 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 06 21:30:24.465524 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 06 21:30:24.465524 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 06 21:30:24.465524 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 06 21:30:24.465524 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 06 21:30:24.465524 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Id: 0ca0b63bd9224370b45e7cc5e9c68a27 Sep 06 21:30:24.465524 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:30:24.465524 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Role: reader,member Sep 06 21:30:24.465524 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Sep 06 21:30:24.467224 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0ca0b63bd9224370b45e7cc5e9c68a27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0ca0b63bd9224370b45e7cc5e9c68a27", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ca0b63bd9224370b45e7cc5e9c68a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ca0b63bd9224370b45e7cc5e9c68a27"}]}] Sep 06 21:30:24.467224 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:30:24.467224 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 0ca0b63bd9224370b45e7cc5e9c68a27 Sep 06 21:30:24.467224 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:30:24.467224 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-1682827976-project Sep 06 21:30:24.467224 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 06 21:30:24.467224 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 06 21:30:24.467224 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Id: e22472efcb9a454688744457cb45eabb Sep 06 21:30:24.467224 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-1682827976-project Sep 06 21:30:24.467224 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: method: > Sep 06 21:30:24.467224 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: exception: Instance 17b54989-ef84-453f-920e-766847e1d0ed could not be found. Sep 06 21:30:24.467224 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: action_args: {'id': '17b54989-ef84-453f-920e-766847e1d0ed'} Sep 06 21:30:24.468300 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:30:24.468300 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:24.468300 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:30:24.468300 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:30:24.468300 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:30:24.468300 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:30:24.468300 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:30:24.468300 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:30:24.468300 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:30:24.468300 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:30:24.468300 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17b54989-ef84-453f-920e-766847e1d0ed could not be found. Sep 06 21:30:24.468300 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:30:24.468300 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:30:24.468300 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:30:24.468300 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:24.468300 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:30:24.468300 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:30:24.468300 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:30:24.468300 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:30:24.468300 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:30:24.469817 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:30:24.469817 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:30:24.469817 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:30:24.469817 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:30:24.469817 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:30:24.469817 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:30:24.469817 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:30:24.469817 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17b54989-ef84-453f-920e-766847e1d0ed could not be found. Sep 06 21:30:24.469817 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:30:24.469817 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:30:24.469817 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:30:24.469817 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:24.469817 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:30:24.469817 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:30:24.469817 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:30:24.469817 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:30:24.469817 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17b54989-ef84-453f-920e-766847e1d0ed could not be found. Sep 06 21:30:24.469817 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:30:24.471347 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a52a1de3-52fe-4697-aee0-8784d52576bc tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Returning 404 to user: Instance 17b54989-ef84-453f-920e-766847e1d0ed could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:30:24.471347 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a52a1de3-52fe-4697-aee0-8784d52576bc tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed" status: 404 len: 111 microversion: 2.1 time: 0.034602 Sep 06 21:30:24.471347 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 685/1378] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:30:24 2022] GET /compute/v2.1/servers/17b54989-ef84-453f-920e-766847e1d0ed => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 21:30:24.484574 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-652abe33-1dbd-4c04-b0ee-4ec10d46c7ba tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:30:24.496865 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-652abe33-1dbd-4c04-b0ee-4ec10d46c7ba tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1554 microversion: 2.1 time: 0.195019 Sep 06 21:30:24.498638 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 694/1379] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:30:24 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1554 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:30:25.519603 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-71773bd9-beb9-493d-9d7b-5b160feb445a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:30:25.520230 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-71773bd9-beb9-493d-9d7b-5b160feb445a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:30:25.527081 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71773bd9-beb9-493d-9d7b-5b160feb445a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:25.527557 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71773bd9-beb9-493d-9d7b-5b160feb445a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:25.527987 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71773bd9-beb9-493d-9d7b-5b160feb445a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:25.528688 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71773bd9-beb9-493d-9d7b-5b160feb445a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:25.529148 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71773bd9-beb9-493d-9d7b-5b160feb445a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:25.529574 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71773bd9-beb9-493d-9d7b-5b160feb445a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:25.550507 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:25.622644 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9f85fe62-d55e-4856-b336-ce5a8132a7c2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:30:25.623440 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9f85fe62-d55e-4856-b336-ce5a8132a7c2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:30:25.630498 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f85fe62-d55e-4856-b336-ce5a8132a7c2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:25.630973 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f85fe62-d55e-4856-b336-ce5a8132a7c2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:25.631425 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f85fe62-d55e-4856-b336-ce5a8132a7c2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:25.632252 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f85fe62-d55e-4856-b336-ce5a8132a7c2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:25.632943 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f85fe62-d55e-4856-b336-ce5a8132a7c2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:25.633348 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f85fe62-d55e-4856-b336-ce5a8132a7c2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:25.648955 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-9f85fe62-d55e-4856-b336-ce5a8132a7c2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] HTTP exception thrown: Instance 84876df2-af4d-4824-a96b-039881a934d3 could not be found. Sep 06 21:30:25.650528 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9f85fe62-d55e-4856-b336-ce5a8132a7c2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Request method failure captured: Sep 06 21:30:25.650528 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3 HTTP/1.1 Sep 06 21:30:25.650528 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:30:25.650528 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:30:25.650528 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:30:25.650528 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:30:25.650528 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:30:25.650528 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:30:25.650528 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:30:25.650528 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:30:25.650528 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7oBRUaWFmUaRMRrY2lmG27XTCe8m7oOenu15JckXMhNFYDIb6s6CTPHxEIINys886U3nqIXNvhOhvtXDn-W2TtU1LkNmSf6teGC7l2Pr1U-HL4_5PeX8X3jMoeu0l-wC_3RYNggU9GitVP5pFTsCQ7cQZQ9cQw1uf_6XEJXvRawCjA Sep 06 21:30:25.650528 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:30:25.650528 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:30:25.650528 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:30:25.650528 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:30:25.650528 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:30:25.650528 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:30:25.650528 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: 0ca0b63bd9224370b45e7cc5e9c68a27 Sep 06 21:30:25.650528 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:30:25.650528 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:30:25.650528 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:30:25.652231 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0ca0b63bd9224370b45e7cc5e9c68a27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0ca0b63bd9224370b45e7cc5e9c68a27", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ca0b63bd9224370b45e7cc5e9c68a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ca0b63bd9224370b45e7cc5e9c68a27"}]}] Sep 06 21:30:25.652231 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:30:25.652231 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 0ca0b63bd9224370b45e7cc5e9c68a27 Sep 06 21:30:25.652231 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:30:25.652231 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeNegativeTest-1682827976-project Sep 06 21:30:25.652231 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:30:25.652231 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:30:25.652231 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: e22472efcb9a454688744457cb45eabb Sep 06 21:30:25.652231 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeNegativeTest-1682827976-project Sep 06 21:30:25.652231 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: > Sep 06 21:30:25.652231 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Instance 84876df2-af4d-4824-a96b-039881a934d3 could not be found. Sep 06 21:30:25.652231 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'id': '84876df2-af4d-4824-a96b-039881a934d3'} Sep 06 21:30:25.656310 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:30:25.656310 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:25.656310 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:30:25.656310 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:30:25.656310 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:30:25.656310 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:30:25.656310 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:30:25.656310 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:30:25.656310 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:30:25.656310 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:30:25.656310 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84876df2-af4d-4824-a96b-039881a934d3 could not be found. Sep 06 21:30:25.656310 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:30:25.656310 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:30:25.656310 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:30:25.656310 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:25.656310 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:30:25.656310 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:30:25.656310 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:30:25.656310 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:30:25.656310 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:30:25.657902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:30:25.657902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 21:30:25.657902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 21:30:25.657902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 21:30:25.657902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 21:30:25.657902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:30:25.657902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:30:25.657902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:30:25.657902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:30:25.657902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84876df2-af4d-4824-a96b-039881a934d3 could not be found. Sep 06 21:30:25.657902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:30:25.657902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:30:25.657902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:30:25.657902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:25.657902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:30:25.657902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:30:25.657902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:30:25.657902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:30:25.657902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84876df2-af4d-4824-a96b-039881a934d3 could not be found. Sep 06 21:30:25.657902 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:30:25.659989 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9f85fe62-d55e-4856-b336-ce5a8132a7c2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Returning 404 to user: Instance 84876df2-af4d-4824-a96b-039881a934d3 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:30:25.659989 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9f85fe62-d55e-4856-b336-ce5a8132a7c2 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "DELETE /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3" status: 404 len: 111 microversion: 2.1 time: 0.034482 Sep 06 21:30:25.659989 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 695/1380] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Sep 6 21:30:25 2022] DELETE /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:30:25.660682 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2c178d75-69cf-4506-a395-116d5922bb95 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:30:25.661320 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2c178d75-69cf-4506-a395-116d5922bb95 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] [instance: 84876df2-af4d-4824-a96b-039881a934d3] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:30:25.667722 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c178d75-69cf-4506-a395-116d5922bb95 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:25.668200 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c178d75-69cf-4506-a395-116d5922bb95 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:25.668724 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c178d75-69cf-4506-a395-116d5922bb95 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:25.669562 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c178d75-69cf-4506-a395-116d5922bb95 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:25.669765 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c178d75-69cf-4506-a395-116d5922bb95 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:25.670258 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c178d75-69cf-4506-a395-116d5922bb95 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:25.684699 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-2c178d75-69cf-4506-a395-116d5922bb95 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] HTTP exception thrown: Instance 84876df2-af4d-4824-a96b-039881a934d3 could not be found. Sep 06 21:30:25.686265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2c178d75-69cf-4506-a395-116d5922bb95 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Request method failure captured: Sep 06 21:30:25.686265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3 HTTP/1.1 Sep 06 21:30:25.686265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 06 21:30:25.686265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 06 21:30:25.686265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Connection: close Sep 06 21:30:25.686265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 06 21:30:25.686265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 06 21:30:25.686265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Host: 10.222.0.79 Sep 06 21:30:25.686265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 06 21:30:25.686265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 06 21:30:25.686265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjF7oBRUaWFmUaRMRrY2lmG27XTCe8m7oOenu15JckXMhNFYDIb6s6CTPHxEIINys886U3nqIXNvhOhvtXDn-W2TtU1LkNmSf6teGC7l2Pr1U-HL4_5PeX8X3jMoeu0l-wC_3RYNggU9GitVP5pFTsCQ7cQZQ9cQw1uf_6XEJXvRawCjA Sep 06 21:30:25.686265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 06 21:30:25.686265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 06 21:30:25.686265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 06 21:30:25.686265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 06 21:30:25.686265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 06 21:30:25.686265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 06 21:30:25.686265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Id: 0ca0b63bd9224370b45e7cc5e9c68a27 Sep 06 21:30:25.686265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:30:25.686265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Role: reader,member Sep 06 21:30:25.686265 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Roles: reader,member Sep 06 21:30:25.687975 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0ca0b63bd9224370b45e7cc5e9c68a27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0ca0b63bd9224370b45e7cc5e9c68a27", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ca0b63bd9224370b45e7cc5e9c68a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ca0b63bd9224370b45e7cc5e9c68a27"}]}] Sep 06 21:30:25.687975 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:30:25.687975 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 0ca0b63bd9224370b45e7cc5e9c68a27 Sep 06 21:30:25.687975 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1682827976 Sep 06 21:30:25.687975 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeNegativeTest-1682827976-project Sep 06 21:30:25.687975 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 06 21:30:25.687975 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 06 21:30:25.687975 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Id: e22472efcb9a454688744457cb45eabb Sep 06 21:30:25.687975 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeNegativeTest-1682827976-project Sep 06 21:30:25.687975 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: method: > Sep 06 21:30:25.687975 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: exception: Instance 84876df2-af4d-4824-a96b-039881a934d3 could not be found. Sep 06 21:30:25.687975 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: action_args: {'id': '84876df2-af4d-4824-a96b-039881a934d3'} Sep 06 21:30:25.692378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:30:25.692378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:25.692378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:30:25.692378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:30:25.692378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:30:25.692378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:30:25.692378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:30:25.692378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:30:25.692378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:30:25.692378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:30:25.692378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84876df2-af4d-4824-a96b-039881a934d3 could not be found. Sep 06 21:30:25.692378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:30:25.692378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:30:25.692378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:30:25.692378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:25.692378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:30:25.692378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:30:25.692378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:30:25.692378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:30:25.692378 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:30:25.694675 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:30:25.694675 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:30:25.694675 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:30:25.694675 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:30:25.694675 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:30:25.694675 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:30:25.694675 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:30:25.694675 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84876df2-af4d-4824-a96b-039881a934d3 could not be found. Sep 06 21:30:25.694675 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:30:25.694675 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:30:25.694675 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:30:25.694675 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:25.694675 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:30:25.694675 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:30:25.694675 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:30:25.694675 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:30:25.694675 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84876df2-af4d-4824-a96b-039881a934d3 could not be found. Sep 06 21:30:25.694675 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 06 21:30:25.696090 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2c178d75-69cf-4506-a395-116d5922bb95 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] Returning 404 to user: Instance 84876df2-af4d-4824-a96b-039881a934d3 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:30:25.696090 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2c178d75-69cf-4506-a395-116d5922bb95 tempest-AttachVolumeNegativeTest-1682827976 tempest-AttachVolumeNegativeTest-1682827976-project] 10.222.0.79 "GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3" status: 404 len: 111 microversion: 2.1 time: 0.030788 Sep 06 21:30:25.696090 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 696/1381] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:30:25 2022] GET /compute/v2.1/servers/84876df2-af4d-4824-a96b-039881a934d3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:30:25.732146 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-71773bd9-beb9-493d-9d7b-5b160feb445a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52264275fdb411484cfc6b39b625d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca88b1d59a924130a3fa43b0b256c33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 21:30:25.749168 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-71773bd9-beb9-493d-9d7b-5b160feb445a tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 200 len: 1554 microversion: 2.1 time: 0.232934 Sep 06 21:30:25.750094 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 686/1382] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:30:25 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 1554 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 21:30:26.171076 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-c7c52a14-8431-443c-9fc8-8d54d281853b req-b2cacfda-9787-411e-bea7-b87ba1a6e3e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65014e74-e05a-4c89-ad8b-ec4bab8b9bf4", "name": "network-vif-deleted", "tag": "c91372e9-966e-469c-bdfc-85d1774fc70b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 21:30:26.181772 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c7c52a14-8431-443c-9fc8-8d54d281853b req-b2cacfda-9787-411e-bea7-b87ba1a6e3e3 service nova] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:26.182327 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c7c52a14-8431-443c-9fc8-8d54d281853b req-b2cacfda-9787-411e-bea7-b87ba1a6e3e3 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:26.182820 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-c7c52a14-8431-443c-9fc8-8d54d281853b req-b2cacfda-9787-411e-bea7-b87ba1a6e3e3 service nova] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:26.195166 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-c7c52a14-8431-443c-9fc8-8d54d281853b req-b2cacfda-9787-411e-bea7-b87ba1a6e3e3 service nova] Creating event network-vif-deleted:c91372e9-966e-469c-bdfc-85d1774fc70b for instance 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 on hv-cinder-74915 Sep 06 21:30:26.201586 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-c7c52a14-8431-443c-9fc8-8d54d281853b req-b2cacfda-9787-411e-bea7-b87ba1a6e3e3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034106 Sep 06 21:30:26.203819 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 697/1383] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Sep 6 21:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 21:30:26.773238 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-60ea6792-deb1-48e0-a3ae-1b06871a6b9d tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:30:26.773842 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-60ea6792-deb1-48e0-a3ae-1b06871a6b9d tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] [instance: 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 21:30:26.780859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60ea6792-deb1-48e0-a3ae-1b06871a6b9d tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:26.781654 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60ea6792-deb1-48e0-a3ae-1b06871a6b9d tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:26.781791 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60ea6792-deb1-48e0-a3ae-1b06871a6b9d tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:26.782501 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60ea6792-deb1-48e0-a3ae-1b06871a6b9d tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Acquiring lock "3890bd42-8750-4042-bca7-2b0af0e72591" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 21:30:26.782953 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60ea6792-deb1-48e0-a3ae-1b06871a6b9d tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 21:30:26.783373 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60ea6792-deb1-48e0-a3ae-1b06871a6b9d tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Lock "3890bd42-8750-4042-bca7-2b0af0e72591" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 21:30:26.807483 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-60ea6792-deb1-48e0-a3ae-1b06871a6b9d tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] HTTP exception thrown: Instance 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 could not be found. Sep 06 21:30:26.809190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-60ea6792-deb1-48e0-a3ae-1b06871a6b9d tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Request method failure captured: Sep 06 21:30:26.809190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 HTTP/1.1 Sep 06 21:30:26.809190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 06 21:30:26.809190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 06 21:30:26.809190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Connection: close Sep 06 21:30:26.809190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 06 21:30:26.809190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 06 21:30:26.809190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Host: 10.222.0.79 Sep 06 21:30:26.809190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 06 21:30:26.809190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 06 21:30:26.809190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjF7sotMo77B6CcTJ3FOW_hDUv1m4WjtSZU_YA7Y5SKjLqB_QO7vgRNm0csmB0hW_uBUg8Ia9qdE6_1wRkV_LlALwcvj0YcZIJSODInyM4AbhETq6b1eldXFyhG60y3MTEJna5cxqZJoz-6IW6FqvnML3eAHeEr4KnzSeDk8IXrdTJxd4 Sep 06 21:30:26.809190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 06 21:30:26.809190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 06 21:30:26.809190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 06 21:30:26.809190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 06 21:30:26.809190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 06 21:30:26.809190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 06 21:30:26.809190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Id: ca88b1d59a924130a3fa43b0b256c33e Sep 06 21:30:26.809190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-TestMinimumBasicScenario-459554959 Sep 06 21:30:26.809190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Role: reader,member Sep 06 21:30:26.809190 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Sep 06 21:30:26.810859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ca88b1d59a924130a3fa43b0b256c33e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ca88b1d59a924130a3fa43b0b256c33e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca88b1d59a924130a3fa43b0b256c33e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca88b1d59a924130a3fa43b0b256c33e"}]}] Sep 06 21:30:26.810859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-TestMinimumBasicScenario-459554959 Sep 06 21:30:26.810859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Id: ca88b1d59a924130a3fa43b0b256c33e Sep 06 21:30:26.810859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestMinimumBasicScenario-459554959 Sep 06 21:30:26.810859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User: tempest-TestMinimumBasicScenario-459554959-project Sep 06 21:30:26.810859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 06 21:30:26.810859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 06 21:30:26.810859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Id: d52264275fdb411484cfc6b39b625d8b Sep 06 21:30:26.810859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-TestMinimumBasicScenario-459554959-project Sep 06 21:30:26.810859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: method: > Sep 06 21:30:26.810859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: exception: Instance 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 could not be found. Sep 06 21:30:26.810859 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: action_args: {'id': '65014e74-e05a-4c89-ad8b-ec4bab8b9bf4'} Sep 06 21:30:26.811723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 21:30:26.811723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:26.811723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 21:30:26.811723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 21:30:26.811723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 21:30:26.811723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 21:30:26.811723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 21:30:26.811723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 21:30:26.811723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 21:30:26.811723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 21:30:26.811723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 could not be found. Sep 06 21:30:26.811723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:30:26.811723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:30:26.811723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:30:26.811723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:26.811723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:30:26.811723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:30:26.811723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 21:30:26.811723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 21:30:26.811723 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 21:30:26.814427 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 21:30:26.814427 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 21:30:26.814427 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 21:30:26.814427 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 21:30:26.814427 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 21:30:26.814427 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 21:30:26.814427 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 21:30:26.814427 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 could not be found. Sep 06 21:30:26.814427 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:30:26.814427 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 21:30:26.814427 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:30:26.814427 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 21:30:26.814427 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 21:30:26.814427 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 21:30:26.814427 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 21:30:26.814427 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 21:30:26.814427 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 could not be found. Sep 06 21:30:26.814427 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 06 21:30:26.817101 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-60ea6792-deb1-48e0-a3ae-1b06871a6b9d tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Returning 404 to user: Instance 65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 21:30:26.817101 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-60ea6792-deb1-48e0-a3ae-1b06871a6b9d tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4" status: 404 len: 111 microversion: 2.1 time: 0.041911 Sep 06 21:30:26.817101 dv-cinder-749155-11-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 687/1384] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Sep 6 21:30:26 2022] GET /compute/v2.1/servers/65014e74-e05a-4c89-ad8b-ec4bab8b9bf4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 21:30:26.820428 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0d361a51-a490-4e97-9829-798d7392e1fb tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] Calling method '.version_select at 0x7f04ce68d940>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 21:30:26.841954 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0d361a51-a490-4e97-9829-798d7392e1fb tempest-TestMinimumBasicScenario-459554959 tempest-TestMinimumBasicScenario-459554959-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1528109863" status: 202 len: 0 microversion: 2.1 time: 0.025838 Sep 06 21:30:26.842550 dv-cinder-749155-11-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 698/1385] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Sep 6 21:30:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1528109863 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)